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(57) Abstract: A method for encoding and decoding information using turbo codes. Turbo codes, though providing error perfor- 
y| mance superior to many codes, exhibit a phenomenon known as error floor. The error floor is a bit error level that turbo codes 
^| themselves have had difficulty improviding on. This error floor can prove problematical lor quasi error Tree applications in which 

error rates on the order of 10.i 0 arc required. In addition turbo codes have failure modes in which errors occur in a burst, which may 
S preclude the establishment of quasi error free communication. Such quasi error free applications also require an error correction that 

is superior to that generally represented by the error floor of turbo-codes. Quasi error free performance can be produced using turbo 
Q codes as an inner code in conjunction with an algebraic outer code linked by an interleaver. A combination of outer algebraic code 
^ and turbo inner code linked by an interleaver, which has a guaranteed minimum Depth between symbols output from the interleaver, 
^ can produce a quasi error free performance in systems utilizing Turbo-Codes without an increase in bandwidth. 
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1 QUASI ERROR FREE (QEF) COMMUNICATION USING TURBO CODES 

FIELD OF THE INVENTION 

The invention relates to methods, apparatus, and signals used in channel coding 
5 and decoding, and, in particular embodiments to methods, apparatus for use with a 
code having a turbo encoded inner code linked to an outer algebraic code via an 
interleaver. 

BACKGROUND OF THE INVENTION 

10 A significant amount of interest has recently been paid to channel coding. For 

example a recent authoritative text states: 

"Channel coding refers to the class of signal transformations designed to improve 
communications performance by enabling the transmitted signals to better withstand 
the effects of various channel impairments, such as noise, interference, and fading. 

15 These, signal-processing techniques can be thought of as vehicles for accomplishing 
desirable system trade-offs (e.g., error-performance versus bandwidth, power versus 
bandwidth). Why do you suppose channel coding has become such a popular way to 
bring about these beneficial effects? The use of large-scale integrated circuits (LSI) 
and high-speed digital signal processing (DSP) techniques have made it possible to 

20 provide as much as 1 0 dB performance improvement through these methods, at much 
less cost than through the use of most other methods such as higher power transmitters 
or larger antennas." 

From "Digital Communications" Fundamentals and Applications Second Edition 
by Bernard Sklar, page 305 © 2001 Prentice Hall PTR. 

25 Stated differently, improved coding techniques may provide systems that can 

operate at lower power, provide higher data rates, or provide lower bit error rates. 

Turbo codes in particular have received recent attention due to their ability to 
obtain good performance over relatively noisy channels. For example bit error rates on 
the order of 10" 5 to 10* 6 can be achieved at signal to noise ratios less than a decibel 

30 away from modulation constrained capacities. However, their use in systems with 
Quasi Error Free (QEF) systems having residual BER requirements of 10~ 10 or lower, 
requires special consideration. This consideration is due partly to the presence of a 
characteristic of turbo codes known as the 'error floor 1 and partly due to a turbo code 
burst error mechanism. 

35 Although Turbo-Codes may recover data at low signal to noise ratios, an increase 

in relative signal strength does not produce a corresponding drop in error rate. In fact 
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1 BERs of 1 0" 6 to 1 0" 7 may persist even for relatively large received signal to noise ratios. 
This problem is further discussed in a paper entitled "Investigating Quasi Error Free 
(QEF) Operation with Turbo Codes", K. Lakovic, C. Jones, J. Villasenor. International 
Symposium on Turbo Codes, Brest, France, September 4-7, 2000, and is incorporated 

5 by reference herein as though set forth in full. Accordingly the use of a turbo codes 
alone may not be sufficient to achieve QEF performance. There is a need in the art for 
systems that may be used with turbo codes and provide QEF type performance. 
Conventions and Definitions: 

Particular aspects of the invention disclosed herein depend upon and are 

10 sensitive to the sequence and ordering of data. To improve the clarity of this disclosure 
the following convention is adopted. Usually, items are listed in the order that they 
appear. Items listed as #1 , #2, #3 are expected to appear in the order #1 , #2, #3 listed, 
in agreement with the way they are read, i.e. from left to right. However, in engineering 
drawings, it is common to show a sequence being presented to a block of circuitry, with 

15 the right most tuple representing the earliest sequence, as shown in Figure 2B, where 
207 is the earliest tuple, followed by tuple 209. The IEEE Standard Dictionary of 
Electrical and Electronics Terms, Sixth Edition, defines tuple as a suffix meaning an 
ordered set of terms (sequence) as in N-tuple. A tuple as used herein is merely a 
grouping of bits having a relationship to each other, such as for example a symbol. 

20 Herein, the convention is adopted that items, such as tuples will be written in the 

same convention as the drawings. That is in the order that they sequentially proceed 
in a circuit. For example, 'Tuples 207 and 209 are accepted by block 1 09" means tuple 
207 is accepted first and then 209 is accepted, as is seen in Figure 2. In other words 
the text will reflect the sequence implied by the drawings. Therefore a description of 

25 Figure 2 would say "tuples 207 and 209 are provided to block 1 09" meaning that tuple 
207 is provided to block 109 before tuple 209 is provided to block 109. 

Herein an interleaver is defined as a device having an input and an output. The 
input accepting data tuples and the output providing data tuples having the same 
component bits as the input tuples, except for order. 

30 An integral tuple (IT) interleaver is defined as an interleaver that reorders tuples 

that have been presented at the input, but does not separate the component bits of the 
input tuples. That is the tuples remain as integral units and adjacent bits in an input 
tuple will remain adjacent, even though the tuple has been relocated. The tuples, which 
are output from an IT interleaver are the same as the tuples input to interleaver, except 

35 for order. Hereinafter when the term interleaver is used, an IT interleaver will be meant. 

A separable tuple (ST) interleaver is defined as an interleaver that reorders the 
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1 tuples input to it in the same manner as an IT interleaver, except that the bits in the 
input tuples are interleaved independently, so that bits that are adjacent to each other 
in an input tuple are interleaved separately and are interleaved into different output 
tuples. Each bit of an input tuple, when interleaved in an ST interleaver, will typically 

5 be found in a different tuple than the other bits of the input tuple from where it came. 
Although the input bits are interleaved separately in an ST interleaver, they are 
generally interleaved into the same position within the output tuple as they occupied 
within the input tuple. So for example, if an input tuple comprising two bits, a most 
significant bit and a least significant bit, is input into an ST interleaver the most 

10 significant bit will be interleaved into the most significant bit position in a first output 
tuple and the least significant bit will be interleaved into the least significant bit position 
in a second output tuple. 

Modulo-N sequence designation is a term meaning the modulo-N of the position 
of an element in a sequence. If there are k item s (l> in a sequence then the items have 

15 ordinal numbers 0 to k-1 , i.e. I 0 through representing the position of each time in the 
sequence. The first item in the sequence occupies position 0, the second item in a 
sequence ^ occupies position 1 , the third item in the sequence l 2 occupies position 2 
and so forth up to item l M , which occupies the k'th or last position in the sequence. The 
modulo-N sequence designation is equal to the position of the item in the sequence 

20 modulo-N . For example, the modulo-2 sequence designation of l 0 =0, the modulo-2 
sequence designation of ^=1 , and the modulo-2 sequence designation of l 2 =0 and so 
forth. 

A modulo-N interleaver is defined as an interleaver wherein the interleaving 
function depends on the modulo-N value of the tuple input to the interleaver. Modulo 
25 interleaves are further defined and illustrated herein. 

A modulo-N encoding system is one that employs one or more modulo 
interleavers. 

SUMMARY OF PREFERRED EMBODIMENTS OF THE INVENTION 
30 In one aspect of the invention, the disclosure illustrates a method for providing 

quasi error free (QEF) encoding by algebraically encoding data, interleaving the 
encoded data in an interleaver having a guaranteed Depth, and turbo encoding the 
interleaved data. 

In another aspect of the invention, the disclosure illustrates a method for 
35 decoding QEF encoded data by turbo decoding the QEF encoded data, deinterleaving 
the data using a deinterleaver having a guaranteed Depth and algebraically decoding 
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1 the deinterleaved data. 

In a further aspect of the invention, the disclosure illustrates an apparatus for 
providing quasi error free (QEF) encoding. The apparatus includes an input that 
accepts data, an algebraic encoder that receives the data, an interleaver, which has a 

5 guaranteed depth, that interleaves the data and a turbo encoder that encodes the 
interleaved data. 

In still a further aspect of the invention, the disclosure illustrates an apparatus for 
providing quasi error free (QEF) encoding. The apparatus includes a turbo decoder that 
accepts QEF data to be decoded, a deinterleaver that accepts the turbo decoded data 
10 and produce deinterleaved data and 

an algebraic decoder that decodes the deinterleaved data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features, aspects, and advantages of the present invention which have been 
15 described in the above summary will be better understood with regard to the following 
description, appended claims, and accompanying drawings where: 

Figure 1 is a graphical illustration of an environment in which embodiments of the 
present invention may operate. 

Figure 2A is a block diagram describing both the encoding and decoding in a 
20 turbo coded system according to an embodiment of the invention. 

Figure 2B is a block diagram of a portion of a signal encoder according to an 
embodiment of the invention. 

Figure 2C is a block diagram of a Ramsey type interleaver as may be used with 
embodiments of the present invention. 
25 Figure 3 is a block diagram of a parallel concatenated (turbo) encoder, illustrating 

the difference between systematic and nonsystematic forms. 

Figure 4 is a schematic diagram of a rate 2/3 "feed forward" convolutional 
nonsystematic encoder. 

Figure 5 is a schematic diagram of a rate 2/3 "recursive" convolutional 
30 nonsystematic encoder. 

Figure 6 is a trellis diagram of the convolutional encoder illustrated in Figure 5. 
Figure 7 is a block diagram of a turbo-trellis coded modulation (TTCM) encoder. 
Figure 8A is a block diagram of a TTCM encoder utilizing multiple interleaves. 
Figure 8B is a graphical illustration of the process of modulo interleaving. 
35 Figure 8C is a further graphical illustration of the process of modulo interleaving. 

Figure 9 is a block diagram of a TTCM encoder employing a tuple interleaver. 
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1 Figure 10 is a block diagram of a TTCM encoder employing a bit interleaves 

Figure 11A is a first portion of combination block diagram and graphical 
illustration of a rate 2/3 TTCM encoder employing a ST interleaver, according to an 
embodiment of the invention. 
5 Figure 11B is a second portion of combination block diagram and graphical . 

illustration of a rate 2/3 TTCM encoder employing a ST interleaver, according to an 
embodiment of the invention. 

Figure 12 is a combination block diagram and graphical illustration of rate Vz 
parallel concatenated encoder (PCE) employing a modulo-N Interleaver. 
10 Figure 13 is a graphical illustration of the functioning of a modulo-4 ST 

interleaver, according to an embodiment of the invention. 

• Figure 14A is a graphical illustration of the generation of interleaver sequences 
from a seed interleaving sequence. 

Figure 14B is a graphical illustration of a process by which modulo-2 and 
15 moduIo-3 interleaving sequences may be generated. 

Figure 14C is a graphical illustration of a process by which a modulo-4 
interleaving sequence may be generated.. 

Figure 1 5 is a graphical illustration of trellis encoding. 
Figure 16 is a graphical illustration of Turbo Trellis Coded Modulation (TTCM) 
20 encoding. 

Figure 17 is a graphical illustration of a rate 2/3 TTCM encoder according to an 
embodiment of the invention. 

Figure 1 8A is a graphical illustration of a rate Vz TTCM encoder, with constituent 
2/3 rate encoders, according to an embodiment of the invention. 
25 Figure 18B is a graphical illustration of alternate configurations of the rate Vz 

TTCM encoder illustrated in Figure 18A. 

Figure 18C is a graphical illustration of alternate configurations of the rate Vz 
TTCM encoder illustrated in Figure 18A, 

Figure 18D is a graphical illustration of alternate configurations of the rate Vz 
30 TTCM encoder illustrated in Figure 18A. 

Figure 18E is a graphical illustration of alternate configurations of the rate Vz 
TTCM encoder illustrated in Figure 18A. 

Figure 19 is a graphical illustration of a rate 3/4 TTCM encoder, with constituent 
2/3 rate encoders, according to an embodiment of the invention. 
35 Figure 20A is a graphical illustration of a rate 5/6 TTCM encoder, with constituent 

2/3 rate encoders, according to an embodiment of the invention. 
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1 Figure 20B is a graphical illustration which represents an alternate encoding that 

will yield the same coding rate as Figure 20A. 

Figure 21 A is a graphical illustration of a rate 8/9 TTCM encoder, with constituent 
2/3 rate encoders, according to an embodiment of the invention. 
5' Figure 21 B is a graphical illustration which represents an alternate encoding that 

will yield the same coding rate as Figure 21A 

Figure 22 is a graphical illustration of map 0 according to an embodiment of the 
invention. 

Figure 23 is a graphical illustration of map 1 according to an embodiment of the 
10 invention. 

Figure 24 is a graphical illustration of map 2 according to an embodiment of the 
invention. 

Figure 25 is a graphical illustration of map 3 according to an embodiment of the 
invention. 

1 5 Figure 26 is a block diagram of a modulo-2 (even/odd) TTCM decoder according 

to an embodiment of the invention. 

Figure 27 is a TTCM modulo-4 decoder according to an embodiment of the 
invention. 

Figure 28 is a graphical illustration of a modulo-N encoder/decoder system 
20 according to an embodiment of the invention. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

Figure 1 is a graphic illustration of an environment in which embodiments of the 
present invention may operate. The environment illustrated at 101 is an information 

25 distribution system, such as may be found in a cable television distribution system. 

In Figure 1 data is provided to the system from an information source 103. For 
purposes of illustration, the information source displayed in Figure 1 may be considered 
to be a cable television system head end which provides video data to end users. A 
formatter 105 accepts data from the information source 103. The data provided by 

30 information source 1 03 may comprise analog or digital signals such as (but not limited 
to) video signals, audio signals, and data signals. The formatter block 105 accepts the 
data from the information source and formats it into an appropriate form, such as 
message tuples, which are illustrated at 107. The formatted data is then provided to 
a channel encoder 109. Channel encoder 109 encodes that data provided to it. In 

35 some embodiments of the present invention, the channel encoder 109 may provide an 
encoding, with different goals depending on the particular implementation, for example 
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1 to make the signal more robust, to reduce the error probability, to operate the system 
using less transmission power or to enable a more efficient decoding of the signal. 
Channel encoder 109 then provides the encoded data to a transmitter 111. The 
transmitter transmits the encoded data provided to it by the channel encoder 109, for 

5 example, using an antenna 113. The signal broadcast from antenna 1 13 is received 
by a relay satellite 1 1 5 and then rebroadcast to a receiving terrestrial antenna, such as 
earth station antenna 117; Earth station antenna 117 collects the satellite signal and 
provides the collected signal to a receiver 119. The receiver 119 will amplify and 
demodulate/detect the signal as appropriate and provide the detected signal to a 

10 decoder 121 . Decoder 121 will essentially, reverse the process of the channel encoder 
109 and recreate the message tuples 123, which should represent a good estimate of 
the message tuples 107 that had been broadcast. The decoder 121 may use Forward 
Error Correction (FEC), in order to correct errors in the received signal. The tuples 123 
provided by the decoder are then provided to a formatting unit 125, which prepares the 

15 received message tuples for use by an information sink, such as the television display 
illustrated at 127. 

Figure 2A is a block diagram describing both the encoding and decoding in a 
turbo coded system according to an embodiment of the invention. 

Data Source 221 provides data tuples to an algebraic encoder 223. Algebraic 

20 encoder 223 produces a stream of encoded codewords. The codewords produced by 
encoder 223 are provided to an interleaver 225. Interleaver 225 is an integral tuple (IT) 
interleaver, meaning that the bits of the symbols input are not rearranged at the output, 
only the order of the input symbols are rearranged. The interleaver 225 can be a variety 
of different types of interleavers, as will be discussed later. For the purposes of 

25 simplifying the disclosure interleaver 225 is illustrated hereinbelow as a Ramsey 
convolutional interleaver. The Ramsey convolutional interleaver was originally 
presented in a paper "Realization of Optimum Interleavers," by J.L. Ramsey, IEEE 
Transactions on Information Theory, Vol IT-16, May 1970, which is incorporated by 
reference herein as though set forth in full. 

30 The interleaved sequence provided by interleaver 225 is turbo encoded in turbo 

encoder 227 and transmitted through either a wireline or wireless channel 229. Turbo 
decoding 231 follows at the received end. The decoded data provided by the turbo 
decoder 231 is provided to a de-interleaver 233 in a process that reverses the 
interleaving process 225. The de-interleaver assembles the received symbols back into 

35 the order in which they were originally produced by the algebraic encoder. 

A particular interleaver implementation is next described in order to illustrate 
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1 diversification of the outer code such that long bursts of errors at the output of the inner 
(turbo) decoder do not preclude the overall coding system from achieving quasi error 
free operation. 

Figure 2B is a block diagram of a portion of a signal encoder according to an 

5 embodiment of the invention. In Figure 2 message tuples 107 are provided to channel 
encoder 109. Channel encoder 109 comprises a Reed-Solomon unit 201, which 
provides a first encoding of the message tuples 107. The Reed-Solomon unit 201 
comprises an exemplary encoder that may be used. Other types of encoders may also 
be used depending on the requirements of the implementations desired. The output 

10 of the Reed-Solomon (RS) unit 201 which includes a RS encoder and may include an 
interleaver is then provided to an interleaver 225. As discussed above the interleaver 
225 is illustrated as a Ramsey interleaver. The type of interleaver used is not as 
important as the depth characteristics produced by the interleaver, and essentially any 
interleaver capable of providing a guaranteed minimum Depth may be used. Depth or 

15 distance between output symbols may be set at a desired level in order to guarantee 
that the burst errors of a certain length may be effectively dealt with. The depth 
necessary to guarantee that burst errors of a certain length may be repaired is a 
function of the depth of separation of input symbols. The greater the depth the larger 
the burst error that may be corrected. The mathematical relationship between depth 

20 and burst size correction is discussed below with respect to Figure 2C. The output of 
interleaver 225 is provided to a turbo trellis-coded modulation (TTCM) encoder 208. 
The interleaved output of the Reed-Solomon unit 201 is then provided to a turbo 
encoder 203, which applies a parallel concatenated (turbo) encoding to the input 
received from the interleaved output of the Reed-Solomon unit 201, and further 

25 provides it to a mapper 205. In addition some of the bits of the interleaved data output 
from the Reed-Solomon unit 201 may bypass the turbo encoder 203 entirely and be 
coupled directly into the mapper 205. 

The output of interleaver 225 is provides to a turbo trellis-coded modulation (TTCM) 
encoder 208. The output of the Reed-Solomon unit 201 is then provided to a turbo 

30 encoder 203, which applies a parallel concatenated (turbo) encoding to the input 
received from the Reed-Solomon unit 201 r and further provides it to a mapper 205. In 
addition, some of the bits of the data output from the Reed-Solomon unit 201 may 
bypass the turbo encoder 203 entirely and be coupled directly into the mapper 205. 
Such data bits which bypasses the turbo encoder 203 are commonly referred to as 

35 uncoded bits. The uncoded bits are taken into account in the mapper 205 but are never 
actually encoded in the turbo encoder 203. In some embodiments of the invention 
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1 there are no uncoded bits. In other embodiments of the invention there may be several 
uncoded bits depending on the data rate of the overall turbo trellis-coded modulation 
(TTCM) encoder desired. The output of the Reed-Solomon unit 201 may vary in form 
depending on the overall rate desired from the TTCM encoder 208. Turbo encoders, 

5 such as that illustrated at 203, may have a variety of forms and classifications. One of 
the classifications of encoders in general and turbo encoders in particular is illustrated 
in Figure 3. 

Figure 2C is a block diagram of a Ramsey type interleaver as may be used with 
embodiments of the present invention. T is equal to the number of burst error symbols 

10 to be corrected. An interleaving scheme which may guarantee a minimum Depth may 
achieve complete correction of an error burst of length up to and including T*Depth from 
the output of the inner decoder by the combination of de-interleaving and outer 
decoding. The illustrated system provides for correction of 20 or less errors per outer 
code block. The depth of the symbols provided by interleaver 225 is 201. The cost of 

15 such a scheme in terms of memory is given by Depth * BLen = 205824 outer code 
symbols, where Blen is the length, in terms of outer code symbols, of an outer code 
block and where outer code symbols are 1 0 bits wide. The outer coding scheme with 
the above listed parameters allows for complete correction of inner decoder burst errors 
of lengths up to 4020 outer code symbols. 

20 The Ramsey interleaver 225 illustrated in figure 2C can be modeled as a ring of 

memory locations. Each memory location is sized so as to hold a bit tuple 
corresponding to the size of the symbols input to the interleaver 225. 

Input symbols are placed in the ring Depth tuples apart. The ringsize is selected 
so that Depth * Blen (where Blen is equal to the length, in terms of the symbols input 

25 into the interleaver, of an outer code block.) is equal to the ring size. Also Depth and 
Blen are selected to be relatively prime numbers, which are not divisors of one another. 
The symbols are placed in the ring Depth apart until the ring is full. Once the ring is full 
the interleaver can output interleaved symbols by outputting sequential symbols from 
the ring as shown generally at 255. 

30 In order to achieve quasi error free communications interleaver 225 guarantees 

that a particular Depth between output symbols will be maintained. Accordingly truly 
random interleaves will not work unless they are constrained so that a minimum Depth 
can be maintained. 

The necessity of being able to correct burst errors in order to achieve a quasi 
35 error free communication using a system as illustrated in figure 2A is not at all obvious. 
Simulations have found that turbo codes exhibit a phenomenon in which certain data 
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1 patterns may cause burst errors of incorrect data. This phenomenon is rare and it does 
not significantly increase the overall error rate by a statistically meaningful level, 
however it may preclude the establishment of a quasi error free communication using 
Turbo Codes. Therefore in order to establish a QEF channel, and enable 

5 communications that require a QEF channel, an interleaver 225 is provided. Such a 
system may be used with any of the turbo encoding and modulo interleaving methods 
described hereinbelow. 

Figure 3 is a block diagram of a parallel concatenated encoder illustrating the 
difference between systematic and nonsystematic forms. In Figure 3 data is input into 

10 the circuit at 301 . Data is output from the parallel concatenated encoder (PCE) circuit 
300 at 303. The data output 303 of the PCE illustrated at 300 may reach the output via 
three different paths. Input data tuples (groups of one or more bits) may be received 
at 301 and coupled directly to the data output 303 through selector mechanism 305 
along the path labeled D. The data input may also be coupled into a first encoder 307 

15 where it will be encoded and then coupled along the path E 1 through selector 305 and 
into data output 303. The data accepted into the PCE circuit at 301 may also be 
provided to an interleaver 309. Interleaver 309 rearranges the input sequence of the 
data accepted by the PCE circuit at 301. In other words, the interleaver shuffles the 
order of the data so that the data out of the interleaver 309 is not the same order as the 

20 data into the interleaver 309. The data out of the interleaver 309 is then provided to a 
second encoder 31 1 . The second encoder 31 1 encodes the data provided to it by the 
interleaver 309 and then provides the encoded data along path E 2 through the selector 
305 into the data output 303. If the selector 305 selects the data from path D and E 1 
and E 2 , where D represents all of the input data tuple, then a systematic-type turbo 

25 encoding is performed. However, if the data selector selects only between path and 
, E 2 , such that there is no direct path between the data input and data output, a 
nonsystematic turbo encoding is performed. In general the data input at 301 comprises 
input data tuples which are to be encoded. The data output at 303 comprises code 
words, which are the encoded representation of the input data tuples. In general, in a 

30 systematic type of encoding, the input tuples are used as part of the output code words 
to which they correspond. Within parallel concatenated encoders, such as that 
illustrated at 300, encoders such as the first encoder 307 and second encoder 31 1 are 
commonly referred to as component or constituent encoders because they provide 
encoding, which are used as components of the overall turbo encoding. The first 

35 encoder 307 and the second encoder 31 1 may also have a variety of forms and may 
be of a variety of types. For example, the first encoder 307 may be a block encoder or 
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1 a convolutional-type encoder. Additionally, the second encoder 311 may also be a 
block or convolutional-type encoder. The first and second encoders themselves may 
also be of systematic or nonsystematicform. The types of encoders may be mixed and 
matched so that, for example, the first encoder 307 may comprise a nonsystematic 

5 encoder and second encoder 31 1 may comprise a systematic-type encoder. 

Constituent encoders, such as first encoder 307 and second encoder 311 may 
have delays incorporated within them. The delays within the encoders may be multiple 
clock period delays so that the data input to the encoder is operated on for several 
encoder clock cycles before the corresponding encoding appears at the output of the 

10 encoder. 

One of the forms of a constituent encoder is illustrated in Figure 4. 
Figure 4 is a schematic diagram of a rate two-thirds feed forward nonsystematic 
convolutional encoder. The encoder illustrated at 400 in Figure 4 is a rate two-thirds 
because there are two inputs 401 and 403 and three outputs 405, 407 and 409. 

15 Accordingly, for each input tuple comprising two input bits 401 and 403, which are 
accepted by the encoder 400, the output is a code word having three bits 405, 407 and 
409. Therefore, for each two bits input at inputs 401 and 403 three bits are output at 
405, 407 and 409. The encoder of Figure 4 comprises three delays 417, 419 and 421 . 
Such delays may be formed from D-type flip flops or any other suitable delay or storage 

20 element. The rate two-thirds feed forward encoder of Figure 4 also comprises five 
modulo-2 adders 41 1 . 41 3, 41 5, 423 and 425. Modulo-2 adders are adders in which 
the outputs of the modulo-2 adder is equal to the modulo-2 sum of the inputs. Delay 
elements 417, 41 9 and 421 are clocked by an encoder clock. Modulo-2 adders 41 1 , 
413, 415, 423 and 425 are combinational circuits which are unclocked. In 

25 combinational circuits the output appears a time delay after the inputs are changed. 
This time delay is due to the propagation time of the signal within the combinational 
circuits (this delay is assumed as a near zero delay herein) and not due to any clocking 
mechanisms. In contrast, a delay unit, such as 417, will not change its output until it 
receives an appropriate clock signal. Therefore, for an input signal to propagate, for 

30 example from input 403 through modulo-2 adder 411, through delay 417, through 
modulo-2 adder 413, through delay 419, through modulo-2 adder 415, through delay 
421 in order to appear at output 409, the encoder clock 427 must first clock the input 
signal from 403 through delay unit 417, then through delay unit 41 9, and finally through 
delay unit 421 . Therefore, once an input signal appears at 403 three encoder clocks 

35 427 in succession will be required for the resultant output 409, which is associated with 
that input at 403, to be seen at the output. 
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1 The encoder of Figure 4 is a feed forward encoder. The signal is always fed 

forward and at no point in the circuit is there a path to feed back a signal from an later 
stage to an earlier stage. As a consequence a feed forward encoder, such as that 
illustrated in Figure 4, is a finite impulse response (FIR) type of state machine. That is, 

5 for an impulse signal applied at the input, the output will eventually settle into a stable 
state. 

The encoder illustrated in Figure 4 may further be classified as a nonsystematic 
encoder because none of the inputs, that is either 401 or 403, appear at the output of 
the encoder. That is outputs 405, 407 or 409 don't reproduce the inputs in an encoded 

10 output associated with that input. This can be inferred from the fact that output 407, 
405 and 409 have no direct connection to inputs 401 or 403. 

Figure 5 is a schematic diagram of a rate two-thirds, recursive, convolutional 
nonsystematic encoder. The encoder of Figure 5 is similar to the encoder of Figure 4 
in that both encoders are nonsystematic and convolutional. The encoder of Figure 5 

15 is the same schematically as the encoder of Figure 4 with the addition of a third input 
at modulo-2 adder 51 1 and a third input at modulo-2 adder 515. The third input for 
each of modulo-2 adders 51 1 and 515 is formed by an additional modulo-2 adder 527. 
Modulo-2 adder 527 is formed in part by the output of delay 521. Modulo-2 adder 527 
receives an input from delay 521 which is provided to modulo-2 adders 511 and 515. 

20 Accordingly the encoder of Figure 5 is recursive. In other words, the inputs of delays 
517 and 521 are partially formed from outputs occurring later in the signal path and fed 
back to an earlier stage in the circuit. Recursive encoders may exhibit outputs that 
change when repeatedly clocked even when the inputs are held constant. The encoder 
of Figure 5 is a constituent encoder, and is used with an embodiment of the invention 

25 as will be described later. Figure 6 is a trellis diagram for the encoder illustrated 

in Figure 5. A trellis diagram is a shorthand method of defining the behavior of a finite 
state machine such as the basic constituent encoder illustrated in Figure 5. The state 
values in Figure 6 represent the state of the encoder. As can be seen from the trellis 
diagram in Figure 6, when the encoder of Figure 5 is in any single state, it may 

30 transition to any one of four different states. It may transition to four different states 
because there are two inputs to the encoder of Figure 5 resulting in four different 
possible input combinations which cause transitions. If there had been only one input 
to the encoder of Figure 5, for example, if inputs 501 and 503 were connected, then 
each state in the trellis diagram would have two possible transitions. As illustrated in 

35 the trellis diagram in Figure 6, if the encoder is in state 0, state 1 , state 2 or state 3, the 
encoder may then transition into state 0, state 2, state 4 or state 6. However, if the 
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1 encoder is in state 4, state 5, state 6 or state 7, it may transition into state 1, state 3, 
state 5 or state 7. 

Figure 7 is a block diagram of a turbo trellis-coded modulation (TTCM) encoder. 
In Figure 7 an input data sequence 701 is provided to an "odd" convolutional encoder 

5 703 and an interleaver 705. The interleaver 705 interleaves the input data sequence 
701 and then provides the resulting interleaved sequence to "even" convolutional 
encoder 707. Encoders 703 and 707 are termed "odd" and "even" respectively because 
encodings corresponding to odd input tuples (i.e. input tuple no. 1, 3, 5, etc.) are 
selected by selector 709 from encoder 703 and encodings corresponding to even input 

10 tuples (i.e. input tuple no. 0, 2, 4, etc.) are selected by selector 709 from encoder 707. 
The output of either the odd convolutional encoder 703 or the even convolutional 
encoder 707 is selected by a selecting mechanism 709 and then passed to a mapper 
710. Figure 7 is a generalized diagram according to an embodiment of the invention 
which illustrates a general arrangement for a TTCM encoder. The odd convolutional 

15 encoder 703 receives the input data sequence and, in an embodiment of the invention, 
convolutionally, nonsystematically, encodes the input data sequence. Even 
convolutional encoder 707 receives the same input data as the odd convolutional 
encoder, except that the interleaver 705 has rearranged the order of the data. The odd 
and even convolutional encoders may be the same encoders, different encoders or 

20 even different types of encoders. For example, the odd convolutional encoder may be 
a nonsystematic encoder, whereas the even convolutional encoder may be a systematic 
encoder. In fact the convolutional encoders 703 and 707 may be replaced by block- 
type encoders such as Hamming encoders or other block-type encoders well known in 
the art. For the purposes of illustration, both constituent encoders 703 and 707 are 

25 depicted as nonsystematic, convolutional, recursive encoders as illustrated in Figure 5 
. The select mechanism 709 selects, from convolutional encoder 703, outputs 
corresponding to odd tuples of the input data sequence 701. The select mechanism 
709 selects, from convolutional encoder 707, outputs which correspond to even tuples 
of the input data sequence 701 . Select mechanism 709 alternates in selecting symbols 

30 from the odd convolutional encoder 703 and the even convolutional encoder 707. The 
selector 709 provides the selected symbols to the mapper 710. The mapper 710 then 
maps the output of either the even convolutional encoder 707 or the odd convolutional 
coder 703 into a data constellation (not shown). In order to maintain a sequence made 
up of distance segments stemming from the even and odd input tuples, the selector 709 

35 selects only encodings corresponding to even tuples of the input data sequence 701 
from one encoder (e.g. 703), and selects only encoding corresponding to odd tuples of 
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1 the input data sequence from the other encoder (e.g. 707). This can be accomplished 
by synchronizing the selection of encoded tuples from the odd (703) and even (707) 
encoders, for example using a clock 71 1 , and by using an odd/even interleaver 705 to 
maintain an even/odd ordering of input data tuples to the even encoder 707. The 

5 odd/even interleaver 705 will be described in detail later. 

The encoder illustrated in Figure 7 is a type which will be known herein as a turbo 
trellis-coded modulation (TTCM) encoder. The interleaver 705, odd convolutional 
encoder 703, even convolutional encoder 707 and selector form a turbo encoder, also 
known as a parallel concatenated encoder (PCE). The encoder is known as a parallel 

10 concatenated encoder because two codings are carried on in parallel. For the parallel 
encoding, in the Figure 7 example one coding takes place in the odd convolutional 
encoder 703, and the other takes place in the even convolutional encoder 707. An 
output is selected sequentially from each encoder and the outputs are concatenated to 
form the output data stream. The mapper 710 shown in Figure 7 provides the trellis 

15 coded modulation (TCM) function. Hence, the addition of the mapper makes the 
encoder a turbo trellis-type encoder. As shown in Figure 1; the encoders may have any 
number of bits in the input data tuple. It is the topology that defines the encoder-type. 

The encoder of Figure 7 is an illustration of only one of the possible 
20 configurations that may form embodiments of the present invention. For example, more 
than one interleaver may be employed, as shown in Figure 8. 

Figure 8A is a block diagram of a TTCM encoder using multiple interleaves 
Figure 8A illustrates an exemplary embodiment of the present invention utilizing N 
interleavers. . 

25 The first interleaver 802 is called the null interleaver or interleaver 1 . Generally 

in embodiments of the invention the null interleaver will be as shown in Figure 8A, that 
is a straight through connection, i.e. a null interleaver. All interleaving in a system will 
be with respect to the null sequence produced by the null interleaver. In the case where 
the null interleaver is merely a straight through connection the null sequence out of the 

30 null interleaver will be the same as the input sequence. The concept of null interleaver 
is introduced as a matter of convenience, since embodiments of the invention may or 
may not have a first interleaver a convenient way to distinguish is to say "where the first 
interleaver is the null interleaver" when the first encoder receives input tuples directly 
and to say "where the first interleaver is an ST interleaver", when an ST interleaver 

35 occupies a position proximal to a first encoder. 

In Figure 8A source input tuples 801 are provided to encoder 811 and to 
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1 interleavers 802 through 809. There are N interleavers counting the null interleaver as 
interleaver No. 1 and N encoders present in the illustration in Figure 8A. Other 
embodiments may additionally add an ST interleaver as interleaver No. 1 to process 
input tuples 801 prior to providing them to encoder 81 1 . 

5 Source tuples T 0 , T, and T 2 are shown as three bit tuples for illustrative purposes. 

However, those skilled in the art will know that embodiments of the invention can be 
realized with a varying number of input bits in the tuples provided to the encoders. The 
number of input bits and rates of encoders 81 1 through 819 are implementation details 
and may be varied according to implementation needs without departing from scope 

10 and spirit of the invention. 

Interleavers 803 through 809 in Figure 8A each receive the same source data 
symbols 801 and produce interleaved sequences 827 through 833. Interleaved 
sequences 827 through 833 are further coupled into encoders 81 3 through 81 9. Select 
mechanism 821 selects an encoded output from encoders 81 1 through 81 9. Selector 

15 821 selects from each encoder 811 through 819 in sequence so that one encoded tuple 
is selected from each encoder in one of every N+1 selections. That is the selection 
number 0 (encoded tuple t 0 ) is chosen from encoder 811, the selection number 1 
(encoded tuple ^ is chosen from encoder 813 V 2 is chosen from encoder 815, and so 
forth. The same selection sequence is then repeated by selector 821, 

20 In order not to. miss any symbols, each interleaver is a modulo-type interleaver. 

To understand the meaning of the term modulo interleaver, one can consider the 
interleaver of Figure 7 as a modulo-2 interleaver. The interleaver of Figure 7 is 
considered a modulo-2 interleaver because input tuples provided to the interleaver 
during odd times (i.e. provided as input tuple 1, 3, 5 etc.) will be interleaved into odd 

25 time positions at the output of the interleaver (e.g. output tuple 77, 105,321 etc.) That 
is the first tuple provided by an odd/even interleaver may be the third, fifth, seventh, etc. 
tuple provided from the interleaver, but not the second, fourth, sixth, etc. The result of 
any modulo-2 operation will either be a 0 or a 1, that is even or odd respectively; 
therefore the interleaver of Figure 7 is termed a modulo-2 or odd/even interleaver. In 

30 general, according to embodiments of the invention, the value of N for a modulo-N 
interleaving system is equal to the number of interleavers counting the Null interleaver 
as the first interleaver in the case where there is no actual first interleaver. The modulo 
interleaving system of Figure 8A is modulo-N because there are N interleaves, including 
null interleaver 1 , interleaving system. The interleavers in a modulo interleaver system 

35 may interleave randomly, S randomly, using a block interleaver, or using any other 
mechanism for interleaving known in the art, with the additional restriction that 
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1 input/output positional integrity be maintained. When a sequence of tuples is 
interleaved, the modulo position value of an output will be the same as the modulo 
positional value of the input tuple. The position of a tuple modulo-N is known as a 
sequence designation, modulo designation, or modulo sequence designation. For 

5 example, in a modulo-4 interleaver the first tuple provided to the interleaver occupies 
position 0 of the input tuple stream. Because 0 modulo-4 is zero the modulo sequence 
designation of the first input tuple is 0 . The tuple occupying the position 0 may then 
be interleaved to a new output position #4, #8, #12, #16, etc., which also have the same 
modulo sequence designation, i.e. 0. The tuples occupying output position #4, #8, #12, 

10 #1 6 all have a sequence designation of 0 because 4 mod 4 = 8 mod 4=12 mod 4 = 16 
mod 4 = 0. Similarly, the input tuple occupying position 2 and having sequence 
designation of 2 may be interleaved to a new output position #6, #10, #14, #20, etc, 
which also have the same modulo sequence designation of 2.. The tuples in output 
positions #6, #10, #14, #20 etc have a modulo sequence designation of 2 because 6 

15 mod 4 = 10 mod 4 = 14 mod 4 = 20 mod 4 = 2. 

For example, in Figure 7 the modulo-2 interleaver 705, also known as an 
odd/even interleaver, may employ any type of interleaving scheme desired with the one 
caveat that the input data sequence is interleaved so that each odd sequence input to 
the interleaver is interleaved into another odd sequence at the output of the interleaver. 

20 Therefore, although interleaver 705 may be a random interleaver, it cannot interleave 
the inputs randomly to any output. It can, however, interleave any odd input to any 
random odd output and interleave any even input into any random even interleaved 
output. In embodiments of the present invention, a modulo interleaving system, such 
as that illustrated in Figure 8A, the interleavers must maintain the modulo positional 

25 integrity of interleaved tuples. For example, if there are 5 interleavers including the null 
interleaver (numbers 0-4) in Figure 8A, then Figure 8A would describe a modulo-5 
interleaving system. In such a system, the input source data would be categorized by 
a modulo sequence number equal to the sequence position of the source data tuple 
modulo-5. Therefore, every input data tuple would have a sequence value assigned to 

30 it between 0 and 4 (modulo-5). In each of the 5 interleavers of the modulo-5 system, 
source data elements (characterized using modulo numbers) could be interleaved in 
any fashion, as long as they were interleaved into an output data tuple having an output 
sequence modulo number designation equal to the input sequence modulo number 
designation. The terms modulo sequence number sequence designation, modulo 

35 position value modulo designation, modulo position all refer to the same modulo 
ordering. 
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1 In other words an interleaver is a device that rearranges items in a sequence. 

The sequence is input in a certain order. An interleaver receives the items form the 
input sequence, I, in the order l 0 , \ v l 2 , etc., I 0 being the first item received, |, being the 
second item received, item l 2 being the third item received. Performing a modulo-N 

5 operation on the subscript of I yields, the modulo-N position value of each input item. 
For example, if N=2 modulo-N position l 0 - Mod 2 (0) = 0 i.e. even, modulo-N position I, 
= Mod 2 (1) = 1 i.e., odd, modulo-N position l 2 = Mod 2 (2) = 0 i.e. even. 

Figure 8B is a graphical illustration of examples of modulo interleaving. 
Interleaving is a process by which input data tuples are mapped to output data tuples. 

10 

Figure 8B illustrates of the process of modulo interleaving. As previously stated 
for the purposes of this disclosure an interleaver is defined as a device having one input 
and one output that receives a sequence of tuples and produces an output sequence 
having the same bit components as the input sequence except for order. That is, if the 

15 input sequence contains X bits having values of one, and Y bits having values of zero 
then the output sequence will also have X bits having values of 1 and Y bits having 
values of zero. An interleaver may reorder the input tuples or reorder the components 
of the input tuples or a combination of both. In embodiments of the invention the input 
and output tuples of an interleaver are assigned a modulo sequence designation which 

20 is the result of a modulo division of the input or output number of a tuple. That is, each 
input tuple is assigned a sequence identifier depending on the order in which it is 
accepted by the interleaver, and each output tuple is assigned a sequence identifier 
depending on the order in which it appears at the output of the interleaver. 

For example, in the case of a modulo-2 interleaver the sequence designation 

25 may be even and odd tuples as illustrated at 850 in Figure 8B. In such an example, the 
input tuple in the 0 position, indicating that it was the first tuple provided, is designated 
as an even tuple T 0 . Tuple T 1f which is provided after tuple T 0 is designated as an odd 
tuple, tuple T 2 , which is provided after Tj is designated as an even tuple and so forth. 
The result of the modulo interleaving is illustrated at 852. The input tuples received in 

30 order T 0 , T 1f T 2 , T 3 , T 5 , T 6 have been reordered to T 2t T 3 , T 6 , T 5 , T 0 , T 1( T 4 . Along with 
the reordered tuples at 852 is the new designation l 0 through l 6 which illustrates the 
modulo sequence position of the interleaved tuples. 

The modulo-2 type interleaver illustrated in figure 8B at 854 can be any type of 
interleaver, for example, a block interleaver, a shuffle interleaver or any other type of 

35 interleaver known in the art if it satisfies the additional constraint that input tuples are 
interleaved to positions in the output sequence that have the modulo position value. 
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1 Therefore an input tuple having an even modulo sequence designation will always be 
interleaved to an output tuple having an even modulo sequence designation and never 
will be interleaved to an output tuple having an odd modulo sequence designation. A 
modulo-3 interleaver 856 will function similarly to a modulo-2 interleaver 854 except that 

5 the modulo sequence designation will not be even and odd but zero, one and two. The 
sequence designation is formed by taking the modulo-3 value of the input position 
(beginning with input position 0. Referring to Figure 8B modulo-3 interleaver 856 
accepts input sequence T 0 , T 1t T 2 , T 3 , T 4 , T 5 and T 6 (858) and interleaves it to 
interleaved sequence 860: T 3 , T 4 , T 5t T 6> T it T 2 which are also designated as 

10 interleaved tuples l 0 through l 6 . 

As a further illustration of modulo interleaving, a modulo-8 interleaver is 
illustrated at 862. The modulo 8 interleaver at 862 takes an input sequence illustrated 
at 864 and produces an output sequence illustrated at 866. The input sequence is 
given the modulo sequence designations of 0 through 7 which is the input tuple number 

15 modulo-8. Similarly, the interleaved sequence is given a modulo sequence designation 
equal to the interleaved tuple number modulo-8 and reordered compared to the input 
sequence under the constraint that the new position of each output tuple has the same 
modulo-8 sequence designation value as its corresponding input tuple. 

In summary, a modulo interleaver accepts a sequence of input tuples which has 

20 a modulo sequence designation equal to the input tuple number modulo-N where N = 
H of the interleaver counting the null interleaver. The modulo interleaver then produces 
an interleaved sequence which also has a sequence designation equal to the 
interleaved tuple number divided by the modulo of the interleaver. In a modulo 
interleaver bits which start out in an input tuple with a certain sequence designation 

25 must end up in an interleaved modulo designation in embodiments of the present 
invention. Each of the N interleavers in a modulo N interleaving system would provide 
for the permuting of tuples in a manner similar to the examples in Figure 86; however, 
each (interleaver would yield a different permutation. 

The input tuple of an interleaver, can have any number of bits including a single 

30 bit. In the case where a single bit is designated as the input tuple, the modulo 
interleaver may be called a bit interleaver. 

Inputs to interleavers may also be arbitrarily divided into tuples. For example, 
if 4 bits are input to in interleaver at a time then the 4 bits may be regarded as a single 
input tuple, two 2 bit input tuples or four 1 bit input tuples. For the purposes of clarity 

35 of the present application if 4 bits are input into an interleaver the 4 bits are generally 
considered to be a single input tuple of 4 bits. The 4 bits however may also be 
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. 1 considered to be Vz of an 8 bit input tuple, two 2 bit input tuples or four 1 bit input tuples 
the principles described herein. If all input bits input to the interleaver are kept together 
and interleaved then the modulo interleaver is designated a tuple interleaver (a.k.a. 
integral tuple interleaver) because the input bits are interleaved as a single tuple. The 

5 input bits may be also interleaved as separate tuples. Additionally, a hybrid scheme 
may be implimented in which the input tuples are interleaved as tuples to their 
appropriate sequence positions, but additionally the bits of the input tuples are 
interleaved separately. This hybrid scheme has been designated as an ST interleaver. 
In an ST interleaver, input tuples with a given modulo sequence designation are still 

10 interleaved to interleaved tuples of similar sequence designations. Additionally, 
however, the individual bits of the input tuple may be separated and interleaved into 
different interleaved tuples (the interleaved tuples must all have the same modulo 
sequence designation as the input tuple from which the interleaved tuple bits were 
obtained). The concepts of a tuple modulo interleaver, a bit modulo interleaver, and a 

15 bit-tuple modulo interleaver are illustrated in the following drawings. 

Figure 9 is a block diagram of TTCM encoder employing a tuple type interleaver. 
In Figure 9 an exemplary input data sequence 901 comprises a sequence of data tuples 
T 0 , T 1f T 2 , T 3 and T 4 . The tuples are provided in an order such that T 0 is provided first, 
T< is provided second, etc. Interleaver 915 interleaves data sequence 901 . The output 

20 of the interleaver comprises a new data sequence of the same input tuples but in 
different order. The data sequence 903, after interleaving, comprises the data tuples 
T 4 , T 3 , T 0l T, and T 2 in that order. The tuple interleaver illustrated in Figure 9 at 915 is 
a modulo-2 or odd/even type interleaver. The original data sequence 901 is provided 
to odd convolutional encoder 905 and the interleaved data sequence 903 is provided 

25 to an even convolutional encoder 907. A select mechanism 909 selects encoded 
outputs from the odd convolutional encoder 905 and the even convolutional encoder 
907, according to the procedure provided below and illustrated in Figure 9, and provides 
the encoder output selected to the mapper 911. The select mechanism 909 
illustratively chooses encoded outputs from the "odd" convolutional encoder 905 that 

30 correspond to odd tuples in the input data sequence 901 . The select device 909 also 
chooses encoded tuples from the even convolutional encoder 907, that correspond to 
the even tuples of input sequence 903. So if the odd convolutional encoder 905 
produces encoded tuples O 0 , 0 2 , 0 3 and 0 4 corresponding to the input sequence 
of data tuples 901, the selector will select 0 1 and 0 3 (which have an odd modulo 

35 sequence designation) to pass through the mapper. In like manner if the even 
convolutional encoder produces symbols E 4 , E 3 , E 0 , E, and E 2 from the input sequence 

-19- 



WO0221 702<A1 ) |http^ www . mic ro patent .co m / 1 30 1 3 31 55341/ 1 057 2 606/wo0 22l 7 02 (A1 ).tifj 



WO 02/21702 



PCT/USO 1/27597 



Page 22 of 8"« T 



1 903 and select mechanism 909 selects E 4 , E 0 and E 2 and passes those encoded tuples 
to the mapper 911. The mapper will then receive a composite data stream 
corresponding to encoded outputs E 4 , E 0 , 0 3 , and E 2 . In this manner an encoded 
version of each of the input data sequence tuples 901 is passed onto the mapper 91 1 . 

5 Accordingly, all of the input data sequence tuples 901 are represented in encoded form 
in the data 913 which is passed onto the mapper 91 1 . Although both encoders encode 
every input tuple, the encoded tuples having an odd sequence designation are selected 
from encoder 905 and the encoded tuples having an even sequence designation are 
selected from encoder 907. In the interleaver 915 of Figure 9, each tuple is maintained 

10 as an integral tuple and there is no dividing of the bits which form the tuple. A 
contrasting situation is illustrated in Figure 10. 

Figure 10 is a block diagram of aTTCM encoder employing a bit type interleaver. 
In Figure 10 an input tuple is represented at 1003 as input bits i 0 through i M . The input 
bits i 0 through i M are coupled into an upper constituent encoder of .1007. The input 

15 tuple 1 003 is also coupled into interleaver 1 005. The interleaver 1 005 is further divided 
into interleavers 1009, 1011 and 1013. Each of the interleavers 1009, 1011 and 1013 
accepts a single bit of the input tuple. The input tuple 1003 is then rearranged in the 
interleaver 1005 such that each bit occupies a new position in the sequence that is 
coupled into the lower constituent encoder 1015. The interleaving performed by the 

20 interleaver 1 005 may be any type of suitable interleaving. For example, the interleaver 
may be a block interleaver a modulo interleaver as previously described, or any other 
type of interleaver as known in the art. 

In the illustrated interleaver of Figure 10 the interleaving sequence provided by 
interleaver 1005, and hence by sub-interleavers 1009, 1011 and 1013, is independent 

25 of the positions of the bits within the input 1003. Input tuple 1001 represents input bits 
which are not passed through either of the constituent encoders 1007 or 1015. The 
upper encoding 1017 comprises the uncoded input tuple 1 001 plus the encoded version 
of input tuple 1003, which has been encoded in the upper constituent encoder 1007. 
The lower encoding 1019 comprises the uncoded input tuple 1001 plus the output of 

30 the lower constituent encoder 1015 which accepts the interleaved version of input tuple 
1003. A selector 1021 accepts either the upper or lower encoding and passes selected 
encoding to a symbol mapper 1023. 

Figure 1 1A is a first part of a combination block diagram and graphic illustration 
of a rate 2/3 TTCM encoder employing a ST interleaver according to an embodiment 

35 of the invention. Figure 11A and 11B in combination illustrate a modulo-2 ST 
interleaver as may be used with a rate 2/3 TTCM encoder. In Figure 1 1 A input tuples 
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1 1101 are provided to a rate 2/3 encoder 1 103. The rate 2/3 encoder 1 1 03 is designated 
as an even encoder because, although it will encode every input tuple, only the tuples 
corresponding to encoded even tuples will be selected from encoder 1103 by the 
selection circuit. Input tuples comprise 2 bits, a most significant bit designated by an 

5 M designation and a least significant bit designated by an L designation. The first tuple 
that will be accepted by the rate 2/3 even encoder 1 103 will be the even tuple 1 105. 
The even input tuple 1 1 05 comprises 2 bits where M 0 is the most significant bit, and L 0 
is the least significant bit. The second tuple to be accepted by the rate 2/3 even 
encoder 1103 is the 1107 tuple. The 1107 tuple is designated as an odd tuple and 

10 comprises a most significant bit M t and a least significant bit L v The input tuples are 
designated even and odd because the interleaver 1109, which is being illustrated in 
Figure 11 A, is modulo-2 interleaver also known as an even/odd interleaver. The same 
principles, however, apply to any modulo-N interleaver. If the modulo interleaver had 
been a mod 3 interleaver instead of a mod 2 interleaver then the input tuples would 

15 have sequence designations 0, 1 and 2. If the modulo interleaver had been a modulo-4 
interleaver then the input tuples would have modulo sequence designations 0, 1 , 2, 3. 
The modulo interleaving scheme, discussed here with respect to modulo-2 interleavers 
and 2 bit tuples, may be used with any size of input tuple as well as any modulo-N 
interleaver. Additionally, any rate encoder 1103 and any type encoder may be used 

20 with the modulo ST interleaving scheme to be described. A rate 2/3 encoder, a modulo- 
2 ST interleaver, and 2 bit input tuples have been chosen for ease of illustration but are 
not intended to limit embodiments of the invention to the form disclosed. In other 
words, the following modulo-2 ST interleaver is chosen along with 2 bit input tuples and 
a rate 2/3 encoder system in order to provide for a relatively uncluttered illustration of 

25 the principles involved. The ST interleaver 1109 in this case actually can be 
conceptualized as two separate bit type interleavers 1111 and 1113. The separation 
of the interleavers is done for conceptual type purposes in order to make the illustration 
of the concepts disclosed easier to follow. In an actual implementation the interleaver 
1 1 09 may be implimented in a single circuit or multiple circuits depending on the needs 

30 of that particular implementation. Interleaver 1111 accepts the least significant bits of 
the input tuple pairs 1101. Note input tuple pairs designate input tuples having a pair, 
i.e. MSB and LSB, of bits. The interleaver 1111 interleaves the least significant bits of 
the input tuple pairs 1101 and provides an interleaved sequence of least significant bits 
of the input tuple pairs for example those illustrated in 1 1 1 5. In the example, only eight 

35 input tuple pairs are depicted for illustration purposes. In an actual implementation the 
number of tuple pairs in a block to be interleaved could number tens of thousands or 
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1 even more. Eight input tuple pairs are used for ease of illustration purposes. The least 
significant bits of the input tuple pairs 1 101 are accepted by the interleaver 1111 in the 
order L 0I L 1f L 2 , L 3 , L 4 , L 5 , L 6 , and L 7 . The interleaver, in the example of Figure 1 1 A, then 
provides an interleaved sequence 1115 in which the least significant bits of the input 

5 tuples have been arranged in the order L 6 , L 5 , L 4 , L 1f L 2 , L 7 , L 0 and L 3 . Note that 
although the least significant bit of the input tuple pairs have been shuffled by the 
interleaver 1111 each least significant bit in an even tuple in the input tuple pairs is 
interleaved to an even interleaved position in the output sequence 1115. In like 
manner, odd least significant bits in the input sequence 1101 are interleaved by 

10 interleaver 1111 into odd position in the output sequence 1115. This is also a 
characteristic of modulo ST interleaving. That is although the data input is interleaved, 
and the interleaving may be done by a variety of different interleaving schemes know 
in the art, the interleaving scheme, however, is modified such that even data elements 
are interleaved to even data elements and odd data elements are interleaved to odd 

15 data elements. In general, in modulo-N interleaves the data input to an interleaver 
would be interleaved to output positions having the same modulo sequence designation 
as the corresponding modulo sequence designation in the input sequence. That is, in 
a modulo-4 interleaver an input data element residing in a input tuple with a modulo 
sequence designation of 3 would end up residing in an interleaved output sequence 

20 with a modulo sequence designation of 3. In other words, no matter what type of 
interleaving scheme the interleaver (such as 1111) uses, the modulo sequence 
designation of each bit of the input data tuples sequence is maintained in the output 
sequence. That is, although the positions of the input sequence tuples are changed the 
modulo interleaved positions are maintained throughout the process. This modulo 

25 sequence designation, here even and odd because a modulo-2 interleaver is being 
illustrated, will be used by the selection mechanism to select encoded tuples 
corresponding to the modulo sequence designation of the input tuples. In other words, 
the modulo sequence designation is maintained both through the interleavers and 
through the encoders. Of course, since the input tuples are encoded the encoded 

30 representation of the tuples appearing at the output of the encoder may be completely 
different and may have more bits than the input tuples accepted by the encoder. 

Similarly, the most significant bits of input tuples 1101 are interleaved in 
interleaver 1113. In the example of Figure 11 A. the sequence M 0 through M 7 is 
interleaved into an output sequence M 2 , M 7 , M 0 , M 5 , M 6 , M 3 , M 4> and M v The interleaved 

35 sequence 1117, produced by interleaving the most significant bits of the input tuples 
1101 in interleaver 1113, along with the interleaved sequence of least significant bits 
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1 1 1 15 is provided to into the "odd" rate 2/3 encoder 1119. Note that in both cases all 
data bits are interleaved into new positions which have the same modulo sequence 
designation as the corresponding input tuples modulo sequence designation. 

Figure 11B is a second part of a combination block diagram and graphic 

5 illustration of a rate 2/3 TTCM encoder employing an ST interleaver. In Figure 1 1 B the 
even rate 2/3 encoder 1 103 and the odd rate 2/3 encoder 1 1 19, as well as the tuples 
input to the encoders, are reproduced for clarity. Even encoder 1 1 03 accepts the input 
tuple sequence 1101. The odd encoder 1119 accepts an input sequence of tuples, 
which is formed from the interleaved sequence of most significant bits 1117 combined 

10 with the interleaved sequence of least significant bits 1115. Both encoders 1 103 and 
1119 are illustrated as rate 2/3 nonsystematic convolutional encoders and therefore 
each have a 3 bit output. Encoder 1119 produces an output sequence 1 1 53. Encoder 
11 03 produces an output sequence 11 51 Both sequences 1151 and 1153 are shown 
in script form in order to indicate that they are encoded sequences. Both rate 2/3 

15 encoders accept 2 bit input tuples and produce 3 bit output tuples. The encoded 
sequences of Figure 1 1 B may appear to have 2 bit elements, but in fact the two letter 
designation and comprise 3 encoded bits each. Therefore, output tuple 1 155 which is 
part of sequence 1 1 53 is a 3 bit tuple. The 3 bit tuple 1 1 55 however, is designated by 
a script M 7 and a script L 5 indicating that that output tuple corresponds to an input tuple 

20 1160, which is formed from most significant bit M 7 and least significant bit L 5 . In like 
manner, output tuple 1157 of sequence 1151 comprises 3 bits. The designation of 
output tuple 1 1 57 as M 0 and L 0 indicates that that output tuple corresponds to the input 
tuple 1101, which is composed of input most significant bit M 0 and input least significant 
bit L 0 . jt is worthwhile to note that output tuple of encoder 1 1 03, which corresponds to 

25 input tuple 1161 maintains the same even designation as input tuple 1161. In other 
words, the output tuple of an encoder in a modulo interleaving system maintains the 
same modulo sequence designation as the input tuple to which it corresponds. 
Additionally, in a ST interleaver input tuple bits are interleaved independently but are 
always interleaved to tuples having the same modulo sequence designation. 

30 Selector mechanism 1 1 63 selects between sequences 1 1 53 and 1151. Selector 

1 163 selects tuples corresponding to an even modulo sequence designation from the 
sequence 1151 and selects tuples corresponding to an odd modulo sequence 
designation from sequence 1153. The output sequence created by such a selection 
process is shown at 1 165. This output sequence is then coupled into mapper 1 167. 

35 The modulo sequence 1165 corresponds to encoded tuples with an even modulo 
sequence designation selected from sequence 1151 and encoded tuples with an odd 
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1 modulo sequence designation selected from 1 1 53. The even tuples selected are tuple 
M 0 L 0 , tuple M 2 L 2 , tuple M 4 L 4 and tuple M 6 Lg. Output sequence also comprises output 
tuples corresponding to odd modulo sequence designation M 7 L 5 , tuple M 5 L 1f tuple M 3 
L 7 and tuple and L 3 . 

5 A feature of modulo tuple interleaving systems, as well as a modulo ST 

interleaving systems is that encoded versions of all the input tuple bits appear in an 
output tuple stream. This is illustrated in output sequence 1165, which contains 
encoded versions of every bit of every tuple provided in the input tuple sequence 1 1 01 . 
Those skilled in the art will realize that the scheme disclosed with respect to 

10 Figures 1 1 A and 1 1 B can be easily extended to a number of interleavers as shown in 
Figure 8A. In such a case, multiple modulo interleavers may be used. Such interleavers 
may be modulo tuple interleavers in which the tuples that will be coupled to the 
encoders are interleaved as tuples or the interleavers may be ST interleavers wherein 
the input tuples are interleaved to the same modulo sequence designation in the output 

15 tuples but the bits are interleaved separately so that the output tuples of the interleavers 
will correspond to different bits than the input sequence. By interleaving tuples and bits 
within tuples a more effective interleaving may be obtained because both bits and 
tuples are interleaved. Additionally, the system illustrated in Figures 11A and 11B 
comprise an encoder 1103 which accepts the sequence of input tuples 1101. The 

20 configuration of Figure 11A and 11B illustrates one embodiment. In a second 
embodiment the input tuples are ST interleaved before being provided to either 
encoder. In this way both the even and odd encoders can receive tuples which have 
had their component bits interleaved, thus forming an interleaving which may be more 
effective. In such a manner, an even encoder may produce a code which also benefits 

25 from IT or ST tuple interleaving. Therefore, in a second illustrative embodiment of the 
invention the input tuples are modulo interleaved before being passed to either encoder. 
The modulo interleaving may be a tuple interleaving, or a ST interleaving. Additionally, 
the types of interleaving can be mixed and matched. 

Additionally, the selection of even and odd encoders is arbitrary and although the 

30 even encoder is shown as receiving uninterleaved tuples, it would be equivalent to 
switch encoders and have the odd encoder receive uninterleaved tuples. Additionally, 
as previously mentioned the tuples provided to both encoders may be interleaved. 

Figure 12 is a combination block diagram and graphical illustration of a rate Vz 
parallel concatenated encoder (PCE) employing a modulo-N interleaves Figure 12 is 

35 provided for further illustration of the concept of modulo interleaving. Figure 12 is an 
illustration of a parallel concatenated encoder with rate J4 constituent encoders 1207 
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1 and 1209. The input tuples to the encoder 1201 are provided to rate Vz encoder 1207. 
Each input tuple, for example, T 0 , T 2 and T n given an input tuple number 
corresponding to the order in which it is provided to the encoder 1207 and interleaver 
1211 . The input tuple number corresponds to the subscript of the input tuple. For 

5 example, T 0 the zero tuple is the first tuple provided to the rate Vz encoder 1207, T t is 
the second tuple provided to the rate Vz encoder 1207, T 2 is the third tuple provided to 
the rate Vz input encoder 1207 and T n is the N plus first tuple provided to the rate Vz 
encoder 1207. The input tuples may be a single bit in which case the output of the rate 
Vz encoder 1207 would comprise 2 bits. The input tuples may also comprise any 

10 number of input bits depending on the number of inputs to the rate Vz encoder 1207. 
The modulo concept illustrated is identical where the rate Vz encoder is provided with 
tuples having a single bit or multiple bits. The input tuples 1201 are assigned a modulo 
sequence designation 1 205. The modulo sequence designation is formed by taking the 
input tuple number modulo-N, which is the modulo order of the interleaver. In the 

15 example illustrated, the modulo order of the interleaver 121 1 is N. Because the modulo 
order of the interleaver is N the modulo sequence designation can be any integer value 
between 0 and N-1 . Therefore, the T 0 tuple has a modulo sequence designation of 0, 
the Ti tuple has a modulo sequence designation of 1, the T^ input tuple has a modulo 
sequence designation of N-1 , the T n input tuple has a modulo sequence designation of 

20 0 and the T n+1 input tuple has a modulo sequence designation of 1 and so forth. 
Interleaver 1211 produces interleaved tuples 1215. Similarly to the input tuples the 
interleaved tuples are given a modulo sequence designation which is the same modulo 
order as the interleaver 121 1. Therefore, if the input tuples have a modulo sequence 
designation from 0 to N-1 then the interleaved tuples will have a modulo sequence 

25 designation of 0 to N-1 . The interleaver 121 1 can interleave according to a number of 
interleaving schemes known in the art. In-order to be. a modulo interleaver, however, 
each of the interleaving schemes must be modified so that input tuples with a particular 
modulo sequence designation are interleaved to interleaved tuples with the same 
modulo sequence designation. The interleaved tuples are then provided to a second 

30 rate Vz encoder 1209. The encoder 1207 encodes the input tuples, the encoder 1209 
encodes the interleaved tuples and selector 1219 selects between the output of the 
encoder 1207 and the output of encoder 1209. It should be obvious from the foregoing 
description that modulo type interleaving can be carried out using any modulo sequence 
designation up to the size of the interleaver. A modulo-2 interleaver is typically referred 

35 to herein as an odd/even interleaver as the modulo sequence designation can have only 
the values of 1 or 0, i.e., odd or even respectively. 
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1 Figure 13 is a graphic illustration of the functioning of a modulo-4 ST interleaver 

according to an embodiment of the invention. In the illustrated example, the modulo-4 
ST interleaver 1301 interleaves a block of 60 tuples. That is the interleaver can 
accommodate 60 input tuples and perform and interleaving on them. Input tuples 24 

5 through 35 are illustrated at 1303, to demonstrate an exemplary interleaving. 
Interleaved tuples 0-59 are illustrated at 1305. Input tuples 24 through 35 are illustrated 
at 1303 as 2 bit tuples. Input tuple 24 includes bit b 00 which is the LSB or least 
significant bit of input tuple 24 and b 01 the MSB or most significant bit of input tuple 24. 
Similarly, input tuple 25 includes b 02 which is the least significant bit (LSB) of tuple 25 

10 and b 03 which is the most significant bit of input tuple 25. Each input tuple 1303 is 
assigned a modulo sequence designation which is equal to the tuple number modulo-4. 
The modulo sequence designation of tuple 24 is 0, the modulo sequence designation 
of tuple 25 is 1, the modulo sequence designation of tuple 26 is 2, the modulo 
sequence designation of tuple 27 is 3, the modulo sequence designation of tuple 28 is 

15 0 and so forth. Because 1301 is a ST interleaver, the bits of each tuple are interleaved 
separately. Although the bits of each tuple are interleaved separately, they are 
interleaved into an interleaved tuple having the same modulo sequence designation, 
i.e. tuple number mod 4 in the interleaved tuple as in the corresponding input tuple. 
Accordingly, bit b 00 the LSB of tuple 24 is interleaved to interleaved tuple number 4 in 

20 the least significant bit position. b 01 the MSB of input tuple 24 is interleaved to 
interleaved tuple 44 in the most significant bit position. Note that the modulo sequence 
designation of input tuple 24 is a 0 and modulo sequence designation of interleaved 
- tuple 4 and interleaved tuple 44 are both 0. Accordingly, the criteria that bits of an input 
tuple having a given modulo sequence designation are interleaved to interleave 

25 positions having the same modulo sequence designation. Similarly, b 02 and b 03 of input 
tuple 25 are interleaved to interleaved tuple 57 and interleaved tuple 37 respectively. 
B 04 and b 05 of input tuple 26 are interleaved to interleaved tuples 2 and 22. In like 
manner the MSB and LSB of all illustrated input tuples 24 through 35 are interleaved 
to corresponding interleaved tuples having the same modulo sequence designation, as 

30 illustrated in Figure 13. 

Figure 14A is a graphical illustration of a method for generating an interleaving 
sequence from a seed interleaving sequence. Interleaves may be implimented in 
random access memory (RAM). In order to interleave an input sequence, an 
interleaving sequence may be used. Because interleaves can be quite large, it may 

35 be desirable that an interleaving sequence occupy as little storage space within a 
system as feasible. Therefore, it can be advantageous to generate larger interleaving 
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1 sequences from smaller, i.e. seed interleaving sequences. Figure 14A is a portion of 
a graphical illustration in which a seed interleaving sequence is used to generate four 
interleaving sequences each the size of the initial seed interleaving sequence. In order 
to illustrate the generation of sequences from the seed interleaving sequence, an 

5 interleaving matrix such as that 1401 may be employed. The interleaving matrix 1401 
matches input positions with corresponding output positions. In the interleaving matrix 
1401 the input positions l 0 through l 5 are listed sequentially. I 0 is the first interleaving 
element to enter the interleaving matrix 1401 . I, is the second element, etc. As will be 
appreciated by those skilled in the art, the input elements l 0 through l 5 may be 

10 considered to be individual bits or tuples. The input positions in the interleaving matrix 
1401 are then matched with the seed sequence. By reading through the interleaving 
matrix 1401 an input position is matched with a corresponding output position. In the 
illustrative example, of the interleaving matrix 1401, input l 0 is matched with the number 
3 of the seed sequence. This means that the l 0 or first element into the interleaving 

15 matrix 1401 occupies position 3 in the resulting first sequence. Similarly, I, will be 
matched with a 0 position in sequence 1 and so forth. In other words, the input 
sequence l 0 , I,, l 2 , l 3 , l 4 , l 5 is reordered according to the seed sequence so that the 
resulting sequence output from the interleaving matrix 1401 is l tl l 2 , l 5 , l 0l l 4 , l 3 where the 
output sequence is obtained by listing the sequence of the output in the usual 

20 ascending order l 0 , l 1f l 2 , l 3 , l 4 , l 5 , where the left most position is the earliest. Put another 
way, the resulting sequence number 1 is {3, 4, 0, 5, 2, 1}, which corresponds to the 
subscript of the output sequence 1409. Similarly, in interleaving matrix 1403 also called 
the inverse interleaving matrix or INTLV" 1 the input sequence 1400 is accepted by the 
interleaving matrix 1403 but instead of being written into this interleaving matrix 

25 sequentially, as in the case with interleaving matrix 1401 , the elements are written into 
the interleaving matrix according to the seed sequence. The interleaving matrix 1403 
is known as the inverse of interleaving matrix 1401 because by applying interleaving 
matrix 1401 and then successively applying inverse interleaving matrix 1403 to any 
input sequence, the original sequence is recreated. In other words, the two columns 

30 of the interleaving matrix 1401 are swapped in order to get interleaving matrix 1403. 
Resulting output sequence 1411 is l 3 , l 0 , l t , l 5 , l 4 , l 2 . Therefore, sequence number 2 is 
equal to 2, 4, 5, 1, 0, 3. 

The seed interleaving sequence can also be used to create an additional two 
sequences. The interleaving matrix 1405 is similar to interleaving matrix 1401 except 

35 that the time reversal of the seed sequence is used to map the corresponding output 
position. The output then of interleaver reverse (INTLVR 1405) is then l 4 , l 3 , l 0 , l 5 , l 1f l 2 . 
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1 Therefore, sequence 3 is equal to 2, 1 , 5, 0, 3, 4. Next an interleaving matrix 

1407 which is similar to interleaving matrix 1403 is used. Interleaving matrix 1407 has 
the same input position elements as interleaving matrix 1403, however, except that the 
time reversal of the inverse of the seed sequence is used for the corresponding output 

5 position within interleaving matrix 1407. In such a manner, the input sequence 1400 
is reordered to l 2 , l 4 , l 5 , I,, l 0 , l 3 . Therefore, sequence number 4 is equal to 3, 0, 1, 5, 4, 
2, which are, as previously, the subscripts of the outputs produced. Sequences 1 
through 4 have been generated from the seed interleaving sequence. In one 
embodiment of the invention the seed interleaving sequence is an S random sequence 

1 0 as described by S. Dolinar and D. Divsalar in their paper "Weight Distributions for Turbo 
Codes Using Random and Non-Random Permeations," TDA progress report 42-121 , 
JPL, August 1995. 

Figure 14B is a series of tables illustrating the construction of various modulo 
interleaving sequences from sequence 1 through 4 (as illustrated in Figure 14A). Table 

15 1 illustrates the first step in creating an interleaving sequence of modulo-2, that is an 
even/odd interleaving sequence, from sequence 1 and 2 as illustrated in Figure 14A. 
Sequence 1 is illustrated in row 1 of table 1. Sequence 2 is illustrated in row 2 of table 
1. Sequence 1 and sequence 2 are then combined in row 3 of table 1 and are labeled 
sequence 1-2. In sequence 1-2 elements are selected alternatively, i.e. sequentially 

20 from sequence 1 and 2 in order to create sequence 1-2. That is element 1 , which is a 
1, is selected from sequence 1 and placed as element 1 in sequence 1-2. The first 
element in sequence 2, which is a 3, is next selected and placed as the second element 
in sequence 1-2. The next element of sequence 1-2 is selected from sequence 1 , the 
next element is selected from sequence 2, etc. Once sequence 1-2 has been 

25 generated, the position of each element in sequence 1-2 is labeled. The position of 
elements in sequence 1-2 is labeled in row 1 of table 2. The next step in generating the 
interleaving sequence, which will be sequence 5 is to multiply each of the elements in 
sequence 1-2 by the modulo of the sequence being created. In this case, we are 
creating a modulo-2 sequence and therefore, each of the elements in sequence 1-2 will 

30 be multiplied by 2. If a modulo-3 sequence had been created in the multiplication step, 
the elements would be multiplied by 3 as will be seen later. The multiplication step is 
a step in which the combined sequences are multiplied by the modulo of the 
interleaving sequence desired to be created. 

This methodology can be extended to any modulo desired. Once the sequence 

35 1-2 elements have been multiplied times 2, the values are placed in row 3 of table 2. 
The next step is to add to each element, now multiplied by moduIo-N (here N equals 2) 
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1 the modulo-N of the position of the element within the multiplied sequence i.e. the 
modulo sequence designation. Therefore, in a modulo-2 sequence (such as displayed 
in table 2) in the Oth position the modulo-2 value of 0 (i.e. a value of 0) is added. To 
position 1 the modulo-2 value of 1 (i.e. a value of 1) is added, to position 2 the modulo-2 

5 value of 2 (i.e. a value of 0) is added. To position 3 the modulo-2 value of 3 is (i.e. a 
value of 1) is added. This process continues for every element in the sequence being 
created. Modulo position number as illustrated in row 4 of table 2 is then added to the 
modulo multiplied number as illustrated in row 3 of table 2. The result is sequence 5 
as illustrated in row five of table 2. Similarly, in table 3, sequence 3 and sequence 4 are 

10 interspersed in order to create sequence 3-4. In row 1 of table 4, the position of each 
element in sequence 3-4 is listed. In row 3 of table 4 each element in the sequence is 
multiplied by the modulo (in this case 2) of the sequence to be created. Then a modulo 
of the position number is added to each multiplied element. The result is sequence 6 
which is illustrated in row 5 of table 4. 

15 It should be noted that each component sequence in the creation of any modulo 

interleaver will contain all the same elements as any other component sequence in the 
creation of a modulo interleaver. Sequence 1 and 2 have the same elements as 
sequence 3 and 4. Only the order of the elements in the sequence are changed. The 
order of elements in the component sequence may be changed in any number of a 

20 variety of ways. Four sequences have been illustrated as being created through the 
use of interleaving matrix and a seed sequence, through the use of the inverse 
interleaving of a seed sequence, through the use of a timed reversed interleaving of a 
seed sequence and through the use of an inverse of a time interleaved reverse of a 
seed sequence. The creation of component sequences are not limited to merely the 

25 methods illustrated. Multiple other methods of creating randomized and S randomized 
component sequences are known in the art. As long as the component sequences 
have the same elements (which are translated into addresses of the interleaving 
sequence) modulo interleaves can be created from them. The method here described 
is a method for creating modulo interleaves and not for evaluating the effectiveness of 

30 the modulo interleavers. Effectiveness of the modulo interleavers may be dependent 
on a variety of factors which may be measured in a variety of ways. The subject of the 
effectiveness of interleavers is one currently of much discussion in the art. 

Table 5 is an illustration of the use of sequence 1 , 2, and 3 in order to create a 
modulo-3 interleaving sequence. In row 1 of table 5 sequence 1 is listed. In row 2 of 

35 table 5 sequence 2 is listed and in row 3 sequence 3 is listed. The elements of each 
of the three sequences are then interspersed in row 4 of table 5 to create sequence 1 -2- 
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13. 

In table 6 the positions of the elements in sequence 1-2-3 are labeled from 0 to 
17. Each value in sequence 1-2-3 is then multiplied by 3, which is the modulo of the 
interleaving sequence to be created, and the result is placed in row 3 of table 6. In row 

5 4 of table 6 a modulo-3 of each position is listed. The modulo-3 of each position listed 
will then be added to the sequence in row 3 of table 3, which is the elements of 
sequence 1-2-3 multiplied by the desired modulo, i.e. 3. Sequence 7 is then the result 
of adding the sequence 1-2-3 multiplied by 3 and adding the modulo-3 of the position 
of each element in sequence 1-2-3. The resulting sequence 7 is illustrated in table 7 

10 at row 5. As can be seen, sequence 7 is a sequence of elements in which the element 
in the 0 position mod 3 is 0. The element in position 1 mod 3 is 1. The element in 
position 2 mod 3 is 2. The element in position 3 mod 3 is 0 and so forth. This confirms 
the fact that sequence 7 is a modulo-3 interleaving sequence. Similarly, sequence 5 
and 6 can be confirmed as modulo-2 interleaving sequences by noting the fact that 

15 each element in sequence 5 and sequence 6 is an alternating even and odd (i.e. 
modulo-2 equals 0 or modulo-2 equals 1) element. 

Figure 14C is a graphical illustration of creating a modulo-4 sequence from four 
component sequences. In table 7 sequences 1 , 2, 3 and 4 from Figure 14A are listed. 
The elements of sequence 1 , 2, 3 and 4 are then interspersed to form sequence 1-2-3- 

20 4. 

In table 8 row 1 the positions of each element in sequence 1-2-3-4 are listed. In 
row 3 of table 8 each element of sequence 1-2-3-4 is multiplied by a 4 as it is desired 
to create a modulo-4 interleaving sequence. Once the elements of sequence 1-2-3-4 
have been multiplied by 4 as illustrated in row 3 of table 8, each element has added to 

25 it a modulo-4 of the position number, i.e. the modulo sequence designation of that 
element within the 1-2-3-4 sequence. The multiplied value of sequence 1-2-3-4 is then 
added to the modulo-4 of the position in sequence 8 results. Sequence 8 is listed in 
row 5 of table 8. To verify that the sequence 8 generated is a modulo-4 interleaving 
sequence each number in the sequence can be divided mod 4. When each element 

30 in sequence 6 is divided modulo-4 sequence of 0, 1, 2, 3, 0, 1, 2, 3, 0, 1, 2, 3 etc. 
results. Thus, it is confirmed that sequence 8 is a modulo-4 interleaving sequence, 
which can be used to take an input sequence of tuples and create a modulo interleaved 
sequence of tuples. 

Figure 15 is a general graphical illustration of trellis-coded modulation (TCM). 

35 In Figure 15, input tuples designated 1501 are coupled into a trellis encoder 1503. 
Input tuples, for illustration purposes are designated T 0 , T 1f T 2 and T 3 . Within the trellis 
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1 encoder 1503 the input tuples 1501 are accepted by a convolutional encoder 1505. 
The input tuples that have been convolutionally encoded are mapped in a mapper 1 507. 
The TCM process yields a signal constellation represented as a set of amplitude phase 
points (or vectors) on an In phase Quadrature (l-Q) plane; An example of such vectors 

5 illustrated at 1509, 151 1, 1513, and 1515. The vector represented in the l-Q (In phase 
and Quadrature) illustration is well known in the art. The process of convolutionally 
encoding and mapping when taken together is generally referred to as trellis-coded 
modulation. A similar process called turbo trellis-coded modulation (TTCM) is illustrated 
in Figure 16. 

10 Figure 16 is a graphical illustration of TTCM (Turbo Trellis Coded Modulation) 

encoding. In Figure 1 6 input tuples 1601 are provided to a parallel concatenated (turbo) 
encoding module 1603. The parallel concatenated turbo encoding module 1603 may 
comprise a number of encoders and interleaves. Alternatively, the parallel 
concatenated encoder 1603 may comprise a minimum of two encoders and one 

15 interleaver. The output of the turbo encoder is then provided to an output selection and 
puncturing module. In module 1 605 outputs are selected from the constituent encoders 
of the module 1603. The selection of outputs of the different encoders is sometimes 
termed puncturing by various sources in the art, because some of the code bits (or 
parity bits) may be eliminated). Selection of outputs of the constituent encoders within 

20 the present disclosure will be referred to herein as selecting. The term selecting is used 
because, in embodiments of the present invention, encoded tuples are selected from 
different encoders, but encoded tuples corresponding to each of the input tuples are 
represented. For example, there may be an encoder designated the odd encoder from 
which tuples corresponding to encoded versions of odd input tuples are selected. The 

25 other encoder may be termed an even encoder in which the coded versions of the even 
tuples are selected. This process is termed selecting because even though alternating 
encoded tuples are selected from different encoders a coded version of each input is 
represented. That is, in the selection process though some encoded symbols are 
discarded from one encoder and some encoded symbols are discarded from other 

30 constituent encoder(s) the selection and modulo interleaving process is such that 
encoded versions of all input elements are represented. By modulo encoding and 
selecting sequentially from all encoders, encoded versions of all input bits are 
represented. The term puncturing as used herein will be used to describe discarding 
parts or all of encoded tuples which have already been selected. The selected tuples 

35 are provided to a mapping 1607. In embodiments of the present invention the mapping 
may be dependent on the source of the tuple being mapped. That is, the mapping may 
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1 be changed for example depending on whether the tuple being mapped has been 
encoded or not. For example, a tuple from one of the encoders may be mapped in a 
first mapping. An uncoded tuple which has bypassed the encoder however may be 
mapped in a second mapping. Combination tuples in which part of the tuple is encoded 

5 and part of it is uncoded may also have different mappings. A combination of 3 blocks - 
block 1603, parallel concatenated encoding, block 1605, output selection and 
puncturing, and block 1607 mapping comprise what is known as the turbo trellis-coded 
modulation (TTCM) encoder 1609. The output of the TTCM encoder is a series of 
constellation vectors as illustrated by examples at 1611, 1613, 1615 and 1617. 

10 Figure 17 is a graphical illustration of a rate 2/3 encoder according to an 

embodiment of the invention. In Figure 17, input tuples T 0 and T 1 represented at 1701 
are provided to odd encoder 1703. Tuple T 0 comprises bits, b 0 and b 1 tuple 
comprises bits b 2 and b 3 . The input tuples T 0 and T, are also provided to an interleaver 
1705. Interleaver 1705 accepts input tuples (such as T 0 and Tj) and after interleaving, 

1 5 provides the interleaved tuples to the even encoder 1 709. When odd encoder 1 703 is 
accepting tuple T 0f comprising bits b 0 and , even encoder 1709 is accepting an 
interleaved tuple comprising bits i 0 , and i v Similarly, when odd encoder 1703 is 
accepting tuple T, comprising bits b 2 and b 3 even encoder 1709 is accepting an 
interleaved tuple comprising bits i 2 and i 3 . At each encoder clock (EC) both encoders 

20 accept an input tuple. The interleaver 1703 is a modulo-2 (even/odd) ST interleaver. 
Each encoder accepts every input tuple. The even/odd designation refers to which 
encoded tuple is selected to be accepted by the mapper 1715. By maintaining an 
even/odd interleaving sequence and by selecting encoded tuples alternatively from one 
then the other encoder, it can be assured that an encoded version of every input tuple 

25 is selected and passed on to the mapper 1715. For example, the encoded tuple 1711 , 
comprising bits c 3 and c 4 , and c 5 and corresponding to tuple T t is selected and passed 
onto mapper 1715, which maps both even and odd selections according to map 0. 

The encoded tuple c 0 , c 1 and c^, corresponding to input tuple T 0 is not selected 
from the odd encoder 1703. Instead, the tuple comprising bits c' 0) c^, and c' 0 , which 

30 corresponds to the interleaved input i 0 and i 1 is selected and passed on to mapper 1715, 
where it is mapped using map 0. 

Accordingly, all the components of each tuple are encoded in the odd encoder 
and all components of each tuple are also encoded in the even encoder. However, only 
encoded tuples corresponding to input tuples having an odd modulo sequence 

35 designation are selected from odd encoder 1703 and passed to the mapper 1715. 
Similarly only encoded tuples corresponding to input tuples having an even modulo 
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1 sequence designation are selected from even encoder 1709 and passed to mapper 
1703. Therefore, the odd and even designation of the encoders designate which tuples 
are selected from that encoder for the purposes of being mapped. 

Both encoder 1703 and 1709 in the present example of Figure 17 are 

5 convolutional, nonsystematic, recursive encoders according to Figure 5. Although only 
encoded versions of odd tuples are selected from encoder 1703, and only encoded 
versions of even tuples are selected from encoder 1709, because both encoders have 
memory, each encoded output tuple not only contains information from the tuple 
encoded, but also from previous tuples. 

10 The even/odd encoder of Figure 17 could be modified by including modulo-N 

interleaving, modulo-N interleaving could be accomplished by adding the appropriate 
number of both interleavers and encoders, to form a modulo-N TTCM encoder. 
Additionally, other configurations may be possible. For example, interleaver 1 705 may 
be a ST interleaver. As an alternate another interleaver may be added prior to odd 

15 encoder 1703. For example, if a bit interleaver, to separate the input tuple bits were 
added prior to encoder 1703, and interleaver 1705 were an IT interleaver, the overall 
effect would be similar to specifying interleaver 1705 to be an ST interleaver. 

Both encoders 1703 and 1709 are rate 2/3 encoders. They are both 
nonsystematic convolutional recursive encoders but are not be limited to such. 

20 The overall TTCM encoder is a 2/3 encoder because both the odd encoder 1 703 

and the even encoder 1709 accept an input tuple comprising 2 bits and output an 
encoded output tuple comprising 3 bits. So even though the output to mapper 0 
switches between even and odd encoders, both encoders are rate 2/3 and the overall 
rate of the TTCM encoder of Figure 17 remains at 2/3. 

25 Figure 1 8 is a graphical illustration of a rate 14 TTCM encoder implimented using 

the constituent rate 2/3 base encoders, according to an embodiment of the invention. 
In Figure 1 8, exemplary input tuples T 0 and X, are provided to the TTCM encoder 1 800. 
The T 0 tuple comprises a single bit b 0 and the T, tuple comprises a single bit b v b 0 and 
b 1 corresponding to tuples T 0 and T, are provided to odd encoder 1803. Both b 0 and 

30 are also provided to interleaver 1805. At the time when odd encoder 1803 is 

accepting b 0 even encoder is accepting i 0 . i 0 is an output of the interleaver 1805. 
Similarly, \, is a output of interleaver 1 805 that is provided to even encoder 1 809 at the 
same time that bit b n is provided to odd encoder 1803. The interleaver 1805 is an 
odd/even interleaver (modulo-2 ). In such a manner when an odd tuple is being 

35 provided to odd encoder 1803, an interleaver odd tuple is being provided to even 
encoder 1809. When an even tuple is being provided to odd 1 803, an even interleaved 
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1 tuple is being provided to even encoder 1 809. In order to achieve a rate Vz code from 
rate 2/3 constituent encoders, in addition to an input comprising a single input bit, a 
constant bit value provided to 181 1 is a second input of each of the constituent rate 2/3 
encoders 1803 and 1809. In Figure 18A the input bit is shown as being a 0 but could 

5 just as easily be set to a constant value of 1 . Additionally, each encoder input bit might 
be inputted twice to the odd encoder 1803 and the even encoder 1809 as illustrated in 
Figure 18B. Multiple other configurations are possible. For example both encoders 
might receive both input tuples as illustrated in Figure 18C, or one of the inputs might 
be inverted as in Figure 18E. Additionally hybrid combinations, such as illustrated in 

10 Figure 18D are possible. 

The output of odd encoder 1803, which corresponds to input tuple T 0 comprises 
bits c 0 , c 1t c 2 . The output tuple of odd encoder 1803 corresponding to tuple Tj 
comprises bits c 3 , c 4 , and c 5 . At encoder clock EC<j the even encoder 1809 has 
produced an encoded output tuple having bits c' 0l c', and c* 2 . One of the three encoded 

15 bits, in the present illustration c' 2 , is punctured i.e. dropped and the remaining 2 bits are 
then passed through to mapper 1813. During the odd encoder clock OC^ two of three 
of the encoded bits provided by odd encoder 1803 are selected and passed to mapper 
1813. Output bit c 4 is illustrated as punctured, that is being dropped and not being 
passed through the output mapper 1813. Mapper 1813 employs map number 3 

20 illustrated further in Figure 24. For each encoder clock a single input tuple comprising 
1 bit is accepted into the TTCM encoder 1 800. For each clock a 2-bit encoded quantity 
is accepted by mapper 1813. Because for each one bit provided to the encoder, 2 bits 
are outputted, therefore the encoder is a rate Vz encoder. The odd and even encoders 
in the present embodiment are nonsystematic, convolutional, recursive encoders, but 

25 are not limited to such. The encoders may be any combination, for example such as 
systematic, block encoders. Interleaver 1805 is an odd/even interleaver and so odd 
output tuples are accepted by the mapper 1813 from odd encoder 1803 and even 
encoded tuples are accepted by the mapper 1813 from even encoder 1809. In such 
a manner, all input tuples are represented in the output accepted by mapper 1813, even 

30 though some of the redundancy is punctured. Mapper 1813 utilizes map 3 as illustrated 
in Figure 25 for use by rate Vz TTCM encoder 1 800. 

Figure 19 is a graphical illustration of a rate 3/4 TTCM encoder, having 
constituent 2/3 rate encoders, according to an embodiment of the invention. In Figure 
19 the input tuples T 0 and T,, illustrated at 1901 , comprise 3 bit input tuples. Input tuple 

35 T 0 comprises bits b 0 , b 1 and b 2 . Input tuple 1^ comprises bits b 3 , b 4 and b 5 . Bit of 
input tuple T 0 is underlined as is b$ of input tuple T v Bits and bg are underlined 
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1 because neither of these bits will pass through either encoder. Instead, these bits will 
be concatenated to the output of the even or odd encoder and the resulting in a 4 bit 
tuple provided to mapper 1911. b 0 and b A of input tuple T 0 are provided to odd encoder 
1903. At the same time that b 0 and b 1 are being accepted by the odd encoder 1903, 

5 interleaved bits i 0 and are being accepted by even encoder 1909. Interleaver 1905 
is an odd/even (module-2) type interleaver. The encoders illustrated at 1903 and 1909 
are the encoders illustrated in Figure 5. Encoders 1903 and 1909 are the same as the 
encoders illustrated at 1803 and 1809 in Figure 18, 1703 and 1709 in Figure 17 and as 
will be illustrated at 2003 and 2009 in Figure 20A and 2103 and 2109 in Figure 21 A In 

10 other words, the odd encoder and even encoder are rate 2/3, nonsystematic, 
convolutional recursive encoders. Other types of encoders may however be used, and . 
types may be mixed and matched as desired. 

Figure 17 through 21 are encoding arrangements that utilize the same basic 
encoder as illustrated in Figure 5. In Figure 19, encoders 1903 and 1909 are illustrated 

1 5 as separate encoders for conceptual purposes. Those skilled in the art will realize that 
a single encoder may be used and may be time-shared. Figures 17 through 21 are 
conceptual type Figures and are figures that represent general concepts. They depict 
the general concept accurately regardless of the particular implementation of circuitry 
chosen, in the rate 3/4 encoder of Figure 1 9, the input tuples T 0 , T, (and all other input 

20 tuples to the encoder of Figure 1 9) comprise 3 bits. Since encoders 1 903 and 1 909 are 
rate 2/3 encoders with 2 input bits, then only 2 bits can be accommodated at a 
particular time. Accordingly, bit b 2 of tuple T 0 and bit bg of tuples T, bypass the 
encoders completely, bg is concatenated to the output of odd encoder 1 903, i.e. c 3 , c 4 
and c 5 the combination of encoder tuple c 3 , c 4 , c 5 and are then provided to mapper 

25 1911 which maps the output according to map 2. Map 2 is illustrated in Figure 24. 
Similarly, the output of even encoder 1909, comprising encoded bits c' 0> c\ and c' 2 , is 
combined with bit of input tuple T 0 and then the combination of bg, c' 0 , c' v c ! 2 is 
provided to mapper 191 1 . In such a way the three bits of encoded tuples are converted 
into four bits for mapping in mapper 191 1 . The four bits mapped comprise the three 

30 encoded bits from either the odd or even encoder plus a bit from the input tuple which 
has by passed both encoders. 

Figure 20A is a graphical illustration of a rate 5/6 TTCM encoder, having 
constituent 2/3 rate basic encoders, according to an embodiment of the invention. In 
Figure 20A the input tuples T 0 and are illustrated at 2001 . Input tuple T 0 comprises 

35 five bits, b 0 through b 4 . Input tuple also comprises five bits, b 5 through b 9 . of tuple 
T 0 and bQ of tuple are underlined to illustrate that they do not pass through either 
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1 encoder. The odd encoder 2003 accepts b 0 and b, during a first encoder clock time 
during which even encoder 2009 is accepting interleaved bits i 0 and i t . Bits i 0 and i, are 
the outputs of the interleaver 2005 that correspond to the same time during which inputs 
b 0 and b., are accepted from the odd encoder. Similarly, the odd encoder 2003 is 

5 accepting bits b 2 and b 3 at a time when the even encoder 2009 is accepting bits i 2 and 
i 3 . Similarly, input tuple T,, is separated into 2 bit encoder input tuples because the 
constituent encoders are rate 2/3 encoders which accept 2 bits input and produce three 
encoded bits out. Because each input tuple 2001 is five bits and because each 
encoder allows only a 2 bit input, input tuple T 0 is separated into encoder tuple b 0 and 

10 b 1 and encoder tuple b 2 and b 3 . The encoder therefore, must process two encoder input 
tuples for each input tuple 2001 . Therefore, a single input tuple 2001 will require two 
encoder clocks for processing. The even encoder 2009 encodes tuple i 0 and i, and 
produces corresponding output code bits c' 0 , c^ and c' 2 After processing i 0 and i 1 the 
even encoder 2009 processes i 2 and i 3 The output of even encoder 2009, which 

15 corresponds to input bits i 2 and i 3 is c' 3 , c f 4 and c' 5 . The odd encoder 2003 processes 
a first tuple b 0 and b, and then processes a second tuple b 2 and b 3 . Tuple b 0 and b, are 
accepted by encoder 2003 which produces a corresponding encoded 3 bit tuple c 0? a, 
and c 2 . After accepting b 0 and b 1s the odd encoder 2003 accepts second tuple b 2 and 
b 3 and produces a corresponding output c 3 , c 4l and c 5 . Encoder output Cq, c', and c' 2 

20 corresponding to encoder tuple i 1 and i 0 are provided to mapper 201 1 . Mapper 201 1 
uses map 0 to map c' 0> c\ and c f 2 . Subsequently to producing c' 0 , c\ and c' 2 even 
encoder 2009 accepts i 2 and i 3 and produces output c 3? c 4 , and c 5 . Instead of selecting 
c 3 , c 4 , c 5 to be mapped, uncoded bit ^ is combined with interleaved bits i 2 and i 3 and 
selected. i 2 , i 3 and ^ are then accepted by mapper 201 1 , which employs map 1 to map 

25 bits i 2l i 3 and b^. Therefore, with respect to the overall input tuple T 0 five bits are input 
into the TTCM encoder 2000 and six bits are passed to.mapper 201 1 . In other words, 
a coding rate of 5/6 is generated. Similarly, odd encoder 2003 encodes bits b 5 and b 6 
and produces coded bits c 6 , c 7 and c 8 . Subsequently odd encoder 2003 encodes bits 
b 7 and b 8 and produces coded bits c 9 , c 10 and c 1v c 6 , c 7 and c 8 are passed to the 

30 encoder 2001 as is where they are mapped using map 0. Encoded bit c 9 , c 10 and c 11f 
however, are punctured, i.e. they are dropped and instead bits b 7 , b 8 and b 9 are 
substituted. b 7 , b 8 and bg are passed to encoder 201 1 which uses map 1 to map b 7 , b 8 , 
and b 9 . A graphical illustration of map 0 can be found in Figure 22 and a graphical 
illustration of Map 1 can be found in Figure 23. In the manner just described, a rate 5/6 

35 TTCM encoder is realized from two component rate 2/3 encoders. Interleaver 2005 is 
similar to interleaver 1705, 1805, 1905, 2005 and 2105 which also are even/odd or 
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1 moduIo-2 type interleavers. Other modulo interleaves, just as with all other 
embodiments illustrated in figures 17 through 21, can be realized by adding additional 
interleavers and encoders and by selecting outputs and uncoded bits in a straight 
format manner similar to that illustrated in Figure 20A. 

5 Figure 20B represents an alternate encoding that will yield the same coding rate 

as Figure 20A. 

Figure 21 A is a graphical illustration of a rate 8/9 TTCM encoder realized using 
constituent rate 2/3 encoder, according to an embodiment of the invention. To illustrate 
the functioning of TTCM rate 8/9 encoder 2100 two sequential input tuples T 0 and T 1( 

10 illustrated at 2101, will be considered. Since the constituent encoders are rate 2/3 
having two bits as input and three bits as output, the input tuples will have to be 
subdivided into encoder tuples. In other words, the input tuples will be divided into tuple 
pairs which can be accepted by odd encoder 2103 and even encoder 2109. Odd 
encoder 2103 accepts tuple.pair b 0 and b tl pair b 2 and b 3 , pair b 4 and b 5> pair b 8 and b g , 

15 pair b 10 and b ini and pair b 12 and b 13 sequentially, since the basic 2/3 rate encoder can 
only accept one pair of input bits at a time. Even encoder correspondingly accepts 
input pairs i 0 and i v input pair i 2 and i 3 , input pair i 4 and i 5 , input pair i 8 and i gi input pair 
i 10 and i u , and input pair i 12 and i 13 sequentially. The pairs accepted by the even 
encoder correspond to tuple pairs having the same numbering accepted by the odd 

20 encoder at the same time. That is i 0 and i 1 are accepted by the even encoder 2109 
during the same time period as input pair b 0 and b 1 is accepted by the odd encoder 
2103. Odd and even encoders then produce encoded outputs from the input pairs 
accepted. Even encoder 2909 produces a first encoded output triplet c^, c\ and c 2 
followed by a second output triplet c f 3 , c' 4 and c' 5 followed by a third output triplet c' 6l c' 7 

25 and c' 8 (a triplet is a 3 bit tuple). The first output triplet c' 0 , c^ and c' 2 is accepted by the 
mapper 2111. The mapper 21 1 1 utilizes map 0 to map encoded output c' 0 , c\ and c' 2 . 
Encoded output bits c 3 , c* 4 and c' 5 however are punctured, that is not sent to the 
mapper. Instead of sending c 3 , c' 4 and c' 5 to the mapper 2111 the triplet of bits 
comprising i 2 , i 3 and ^ are sent to the mapper 2111. The mapper 21 1 1 utilizes map 1 

30 as the mapping for the triplet i 2t i 3 , b^ Encoded triplet c' 6 , c' 7 and c' 8 is also punctured. 
That is, it is riot sent to the mapper 2111. Instead, i 4l i s and b 7 is sent to the mapper 
2111 which uses map 1 to map input triplet i 4 , i 5 and b 7 . Because eight bits 
corresponding to tuple T 0 are accepted by the even encoder 2109 and nine bits are 
output into the mapper 2111 the overall encoder 21 00 is a rate 8/9 encoder. Similarly, 

35 input tuple is encoded by the odd encoder 2103. The output triplet from the odd 
encoder c 9 , c 10 and c„ corresponds to input tuple b 8 and b 9 . Next, odd encoder 2103 
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produces an encoded output triplet c 12 , c 13 and c 14J which is an output triplet 
corresponding to input pair b 10 and b 1v Subsequently odd encoder 2103 produces 
output triplet c 15 , c 16 and c 17 . Output triplet c 15 , c 16 and c 17 corresponds to input pair b 12 
and b 13 . Output triplet c 9 , c 10 and c,, are sent to the mapper 21 1 1 which uses map 0 to 
map output triplet c 9 , c 10 and c 1v Output triplet c 12 , c 13 and c 14 however is punctured and 
in its place b 10f b„ and b 14 is sent to mapper 21 1 1 where map 1 is employed to map the 
input triplet b 10 , b u and b 14 . The encoder triplet c 15 , c 16 and c 17 is also punctured and a 
triplet comprising b 12 , b 13 and b 15 is provided to mapper 21 11. Map 1 is used to map the 
input triplet b 12> b 13 and b 15 . In the manner just described an 8/9 encoder is fabricated 
from two constituent rate 2/3 encoder. 

From the foregoing TTCM encoder examples of Figures 17through21 it is seen 
that the basic rate 2/3 encoders can be used in a variety of configurations to produce 
a variety of coding rates. 

The basic constituent encoders illustrated in Figures 17 through 21 are rate 2/3, 
nonsystematic, convolutional recursive encoders. These illustrations represent a few 
examples. Different types of encoders and even different rates of encoders may yield 
many other similar examples. Additionally, encoder types can be mixed and matched; 
for example, a recursive nonsystematic convolution encoder may be used with a 
nonrecursive systematic block encoder. 

Additionally, the interleavers illustrated in Figures 17 through 21 are modulo-2 
(even/odd) ST interleavers. Those skilled in the art will realize that IT type interleavers 
may be. used alternatively in the embodiments of the invention illustrated in Figures 17 
through 21. 

Additionally the TTCM encoders illustrated in Figures 17 through 21 may employ 
modulo-N encoding systems instead of the modulo-2 (even/odd) encoding systems 
illustrated. For example, each of the constituent encoder - modulo-2 interleaver 
subsystems may be replaced by modulo-N subsystems such as illustrated in Figure 8A. 
By maintaining the same type puncturing and selecting with each encoder as displayed 
with the even/odd encoders of Figures 17 through 21 and extending it to modulo-N 
systems, such as illustrated in Figure 8A, the same coding rates can be maintained in 
a modulo-N system for any desired value N. 

Figure 21 B represents an alternate encoding that will yield the same coding rate 
as Figure 21A 

Figure 22 is a graphical illustration of map 0 according to an embodiment of the 
invention. Map 0 is used in the implementation of the rate 2/3 encoder as illustrated in 
Figure 17. Map 0 is also utilized in rate 5/6 encoder illustrating in Figure 20A and rate 
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1 8/9 encoder illustrated in Figure 21 A. 

Figure 23 is a graphical illustration of map 1 according to an embodiment of the 

invention. Map 1 is used by the mapper in the rate 5/6 encoder in Figure 20A, and in 

the mapper in the rate 8/9 encoder in Figure 21 A. 
5 Figure 24 is a graphical illustration of map 2 according to an embodiment of the 

invention. Map 2 is utilized in the fabrication of the rate 3/4 encoder as illustrated in 

Figure 19. 

Figure 25 is a graphical illustration of map 3 according to an embodiment of the 
invention. Map 3 is used in the rate Vz encoder as depicted in Figure 18. 

10 Maps 0 through 3 are chosen through a process different from the traditional 

approach of performing an Ungerboeck mapping (as given in the classic work "Channel 
Coding with Multilevel/Phase Signals" by Gottfried Ungerboeck, IEEE Transactions on 
Information Theory Vol. 28 No. 1 January 1982). In contrast in embodiments of the 
present invention, the approach used to develop the mappings was to select non 

15 Ungerboeck mappings, then to measure the distance between the code words of the 
mapping. Mappings with the greatest average effective distance are selected. Finally 
the mappings with the greatest average effective distance are simulated and those with 
the best performance are selected. Average effective distance is as described by S. 
Dolinar and D. Divsalar in their paper "Weight Distributions for Turbo Codes Using 

20 Random and Non-Random Permeations," TDA progress report 42-121 , JPL, August 
1995. 

Figure 26 is a TTCM decoder according to an embodiment of the invention. 

Figure 26 illustrates a block diagram of the TTCM decoder corresponding to the TTCM 

encoder described above. The TTCM decoder includes a circular buffer 2602, a metric 
25 calculator module 2604, two soft-in soft-out (SISO) modules 2606, 2608, two 

interleaves 2610, 2612, a conditional points processing module 2614, a first-in first-out 

(FIFO) register 2616, and an output processor 2618. 

The TTCM decoder of Figure 26 impliments a MAP (Maximum A Posteriori) 

probability decoding algorithm. 
30 The MAP Algorithm is used to determine the likelihood of the possible particular 

information bits transmitted at a particular bit time. 

Turbo decoders, in general, may employ a SOVA (Soft Output Viterbi Algorithm) 

for decoding. SOVA is derived from the classical Viterbi Decoding Algorithm (VDA). 

The classical VDA takes soft inputs and produces hard outputs a sequence of ones and 
35 zeros. The hard outputs are estimates of values, of a sequence of information bits. In 

general, the SOVA Algorithm takes the hard outputs of the classical VDA and produces 
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1 weightings that represent the reliability of the hard outputs. 

The MAP Algorithm, implimented in the TTCM decoder of Figure 26, does not 
produce an intermediate hard output representing the estimated values of a sequence 
of transmitted information bits. The MAP Algorithm receives soft inputs and produces 
5 soft outputs directly. 

The input to the circular buffer i.e. input queue 2602 is a sequence of received 
tuples. In the embodiments of the invention illustrated in Figure 26, each of the tuples 
is in the form of 8-bit in-phase (I) and 8-bit quadrature (Q) signal sample where each 
sample represents a received signal point or vector in the l-Q plane. The circular buffer 
10 2602 outputs one tuple at a time to the metric calculator 2604. 

The metric calculator 2604 receives I and Q values from the circular buffer 2602 
and computes corresponding metrics representing distances form each of the 8 
members of the signal constellation (using a designated MAP) to the received signal 
sample. The metric calculator 2604 then provides all eight distance metrics (soft inputs) 
15 to the SISO modules 2606 and 2608. The distance metric of a received sample point 
from each of the constellation points represents the log likelihood probability that the 
received sample corresponds to a particular constellation point. For rate 2/3, there are 
8 metrics corresponding to the points in the constellation of whatever map is used to 
encode the data. In this case, the 8 metrics are equivalent to the Euclidean square 
20 distances between the value received and each of the constellation whatever map is 
used to encode the data.. 

SISO modules 2606 and 2608 are MAP type decoders that receive metrics from 
the metric calculator 2604. The SISOs then perform computations on the metrics and 
pass the resulting A Posteriori Probability (APoP) values or functions thereof (soft 
25 values) to the output processor 2618. 

The decoding process is done in iterations. The SISO module 2606 decodes the 
soft values which are metrics of the received values of the first constituent code 
corresponding to the constituent encoder for example 1703 (Figure 17). The SISO 
module 2608 decodes the soft values which are the APoP metrics of the received 
30 values of the second constituent code corresponding to the constituent encoder for 
example 1709 (Figure 17). The SISO modules simultaneously process both codes in 
parallel. Each of the SISO modules computes the metrics corresponding to the input 
bits for every bit position of the in the block of 10K tuples (representing a exemplary 
block of date), and for each of the trellis states that the corresponding encoder could 
35 have been in. 

One feature of the TTCM decoder is that, during each iteration, the two SISO 
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1 modules 2606, 2608 are operating in parallel. At the conclusion of each iteration, 
output from each SISO module is passed through a corresponding interleaver and the 
output of the interleaver is provided as updated or refined A Priori Probability (APrP) 
information to the input of other cross coupled SISO modules for the next iteration. 

5 After the first iteration, the SISO modules 2706, 2708 produce soft outputs to the 

interleaver 2610 and inverse interleaver 2612, respectively. The interleaver 2610 
(respectively, inverse interleaver 2612) interleaves the output from the SISO module 
2606 (respectively, 2608) and provides the resulting value to the SISO module 2608 
(respectively, 2606) as a priori information for the next iteration. Each of the SISO 

10 modules use both the metrics from the metric calculator 2604 and the updated APrP 
metric information from the other cross coupled SISO to produce a further SISO 
Iteration. In the present embodiment of the invention, the TTCM decoder uses 8 
iterations in its decoding cycle. The number of iterations can be adjusted in firmware 
or can be changed depending on the decoding process. 

1 5 Because the component decoders SISO 2606 and 2608 operate in parallel, and 

because the SISO decoders are cross coupled, no additional decoders need to be used 
regardless of the number of iterations made. The parallel cross coupled decoders can 
perform any number of decoding cycles using the same parallel cross coupled SISO 
units (e.g. 2606 and 2608). 

20 At the end of the 8 iterations the iteratively processed APoP metrics are passed 

to the output processor 2618. For code rate 2/3, the output processor 2618 uses the 
APoP metrics output from the interleaver 2610 and the inverse interleaver 2612 to 
determine the 2 information bits of the transmitted tuple. For code rate 5/6 or 8/9, the 
output from the FIFO 2616, which is the delayed output of the conditional points 

25 processing module 2614, is additionally needed by the output processor 2618 to 
determine the uncoded bit, if one is present. 

For rate 2/3, the conditional points processing module 2614 is not needed 
because there is no uncoded bit. For rate 5/6 or 8/9, the conditional points processing 
module 2614 determines which points of the received constellation represent the 

30 uncoded bits. The output processor 2618 uses the output of the SISOs and the output 
of the conditional points processor 2614 to determine the value of the uncoded bit(s) 
that was sent by the turbo-trellis encoder. Such methodology of determining the value 
of an uncoded bit(s) is well known in the art as applied to trellis coding. 

Figure 27 is a TTCM modulo-4 decoder according to an embodiment of the 

35 invention. The modulo four decoder of Figure 27 is similar to the modulo-2 decoder 
illustration in Figure 26. The functions of the input queue 2802, metric calculator 2804, 



-41- 



WQ0221 70g(A1 ) |http://www.micropatent.com/1 301 331 5534 1/1 0572606/wo0221 702(A1 ).tif| 



WO 02/21702 



PCT/US01/27597 



Page 44 of 87 



1 conditional points processor 2814, and first in first out (FIFO) 2816 are similar to their 
counterparts in Figure 26. The signals that will be decoded by the TTCM modulo-4 
decoder Figure 27 is one that has been coded in a modulo-4 interleaving system. 
Therefore, instead of having merely even and odd SISOs and interleavers, SISO 0, 1 , 

5 2 and 3 are used as are interleaver 0, 1 , 2 and 3. Because the data has been encoded 
using a modulo-4 interleaving system, SISOs 0,1,2 and 3 can operate in parallel using 
interleaver 0, 1, 2 and 3. Once the SISOs 0 through 3 have processed through the 
points corresponding to the metrics of the points received in the input queue, the points 
can then be passed on to output process 2818. Output process 2818 will then provide 

10 decoded tuples. 

Figure 28 is a graphical illustration of a modulo-N and encoding and decoding 
system according to an embodiment of the invention. In Figure 28, the encoder 2800 
is a modulo-N encoder. The modulo-N encoder illustrated has N encoders and N-1 
interleavers. The selector, 2801 selects encoded tuples sequentially from the output 

15 of encoders 0 through N. Selector 2801 then passes the selection onto the mapper 
which applies the appropriate mapping. The appropriately mapped data is then 
communicated over a channel 2803 to an input queue 2805. The functions of input 
2805, metric calculator 2807, conditional points processor 2809 and FIFO 2811 are 
similar to those illustrated in Figures 26 and 2478. The decoder 2813 has N SISOs 

20 corresponding to the N encoders. Any desired amount of parallelism can be selected 
for the encoder decoder system with the one caveat that the modulo-N decoding must 
match the modulo-N encoding. By increasing the modulo of the system, more points 
which have been produced by the metric calculator 2807 can be processed at the same 
time. 

25 SISOs 0 through N process the points provided by the metric calculator in 

parallel. The output of one SISO provides A Priori values for the next SISO. For 
example SISO 0 will provide an A Priori value for SISO 1 , SIS0 1 will provide an A Priori 
value for SISO 2, etc. This is made possible because SISO 0 impliments a Map 
decoding algorithm and processes points that have a modulo sequence position of 0 

30 within the block of data being processed, SIS0 1 impliments a Map decoding algorithm 
and processes points that have a modulo sequence position of 1 within the block of 
data being processed, and so forth. By matching the modulo of the encoding system 
to the modulo of the decoding system the decoding of the data transmitted can be done 
in parallel. The amount of parallel processing available is limited only by the size of the 

35 data block being processed and the modulo of the encoding and decoding system that 
can be implimented. 
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1 WHAT IS CLAIMED IS: 

1 . A method for encoding, to provide a quasi error free decoding, the method 
comprising: 

providing data to be communicated; 
5 algebraically encoding the data to be communicated thereby producing 

algebraically encoded data; 

interleaving the algebraic encoded data in an interleaver having a guaranteed 
Depth thereby producing interleaved data; and 

turbo encoding the interleaved data thereby producing turbo encoded data; 

10 

2. The method of claim 1 wherein algebraically encoding the data to be 
communicated comprises Reed-Solomon encoding the data to be communicated. 

3. The method of claim 1 wherein interleaving the algebraic encoded data 
15 comprises using a Ramsey interleaver to interleave the algebraic encoded data. 

4. The method of claim 1 wherein turbo encoding the interleaved data 
comprises modulo-N turbo encoding of the interleaved data. 

20 5. The method of claim 4 wherein N>2. 

6. The method of claim 1 wherein turbo encoding the interleaved data further 
comprises providing at least one nonsystematic component encoding. 

25 7. The method of claim 1 wherein the guaranteed Depth is at least 201 . 

8. A method for decoding quasi error free encoded data the method 
comprising: 

accepting data to be decoded which has been encoded according to the method 
30 of claim 1; 

turbo decoding the data to be decoded; 

deinterleaving the data using a deinterleaver having a guaranteed depth to 
produce deinterleaved data; and 

algebraically decoding the deinterleaved data to produce decoded data. 

35 

9. The method of claim 8 wherein decoding the data to be communicated 
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1 comprises Reed-Solomon decoding the data to be communicated. 

10. The method of claim 8 wherein deinterleaving the data to be decoded 
comprises using a Ramsey deinterleaver to deinterleave the algebraic encoded data. 

5 

11. The method of claim 8 wherein turbo decoding the interleaved data 
comprises modulo-N turbo decoding of the interleaved data. 

12. The method of claim 8 wherein N>2. 

10 

13. The method of claim 11 wherein modulo-N turbo decoding further 
comprises parallel map decoding. 

14. An encoding apparatus the apparatus comprising: 
15 an input that accepts data to be encoded; 

an algebraic encoder that receives the data to be encoded and algebraically 
encodes the data thereby producing algebraically encoded data; 

an interleaver that interleaves the algebraically encoded data, said interleaver 
having a guaranteed Depth, thereby producing interleaved data; and 
20 a turbo encoder that encodes the interleaved data thereby producing turbo 

encoded data; 

15. The apparatus of claim 14 wherein the algebraic encoder comprises a 
Reed-Solomon encoder. 

25 

16. The apparatus of claim 14 wherein the interleaver comprises a Ramsey 
interleaver. 

17. The apparatus of claim 14 wherein the turbo encoder comprises a 
30 modulo-N turbo encoder. 

1 8. The apparatus of claim 4 wherein N>2. 

1 9. The apparatus of claim 1 4 wherein the turbo encoder comprises a turbo- 
35 trellis encoder. 
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1 20. A decoder apparatus comprising: 

a turbo decoder that accepts data to be decoded, which has been encoded 
according to the method of claim 1 , to produce turbo decoded data; 

a deinterleaver that accepts the turbo decoded data and produce deinterleaved 
5 data; and 

an algebraic decoder that decodes the deinterleaved data to produce decoded 

data. 

21 . . The apparatus of claim 20 wherein the algebraic decoder comprises a 
10 Reed-Solomon decoder. 

22 . The apparatus of claim 20 wherein the deinterleaver comprises a Ramsey 
deinterleaver . 

15 23. The apparatus of claim 20 wherein the turbo decoder comprises a 

modulo-N turbo decoder. 

24. The apparatus of claim 20 wherein N>2. 

20 25. The method of claim 1 1 wherein the modulo-N turbo decoder is a parallel 

map decoder. 



30 



35 
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Rate 2/3 basic constituent encoder 

Figure 6 
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Seed Interleaving Sequence = 3, 0, 1, 5, 4, 2 



'is, hJ*h, h, h^ 

Intlv 1401 / 



Input Position 
Corresponding Output Position 



1400 



r 



/ \ 

hi U> hi hi ht h 



Intlv 1 1403 



Input Position^ 

Corresponding Output Position ' 



hi tti h> h> hih 



IntlvR 1405 



Input Position" 
Corresponding Output Position • 



1409 Output Sequence 



I 0 


3 


I. 


0 


I 2 


1 


h 


5 


u 


4 

2 



► h, Io» h> h> I j 
^ Seed Sequence 

Sequence #1 «3,4, 0, 5,2, 1 



1411 Output Sequence 



I3 


0 


lo 


I 


I. 


2 


I 5 


3 


I4 


4 


^h 


5 



»h> U> hi h> h 




>- Inverse of seed sequence 

Sequence #2 = 2, 4, 5, 1,0,3 



1413 Output Sequence 



lo 


2 


Ij 


4 


I2 


5 


I 3 


1 


I4 


0 


^h 


3 



hi Ih Is. hi hi U 



r Time reversal of seed sequence 

Sequence #3 =2, 1,5, 0,3,4 



hi hi hi hi hi h 

IntlvR* 1 H07/ 



h 


5 


lo 


4 


I, 


3 


I5 


2 


I4 


I 


I 2 


0 



1415 Outpi 

->h,h,h,h,h,h S 



1415 Output Sequence 



Input Position"" 
Corresponding Output Position ' 



Time reversal of the inverse of the seed sequence 



Sequence #4 = 3, 0, 1,5,4,2 



Figure 14 A 
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Table I 



Seq.#l 




3 




4 




0 




5 




2 




1 


Seq. #2 


2 




4 




5 




1 




0 




3 




Seq. 1-2 


2 


3 


4 


4 


.5 


0 


1 


5 


0 


2 


3 


1 


Table 2 


Position 


11 


10 


9 


8 


..7 . 


6. 


.5 • 


4 


3 


2 


1 


0 


Seq. 1-2 


2 


3 


4 


4 


5 


0 


1 


5 


0 


2 


3 


1 


X2 (Mod) 


4 


6 


8 


8 


10 


0 


2 


10 


0 


4 


6 


2 


+ mod2 
(Position) 


+1 


+0 


+1 


+0 


+1 


+0 


+1 


+0 


+1 


+0 


+1 


+0 


Seq. 5 


5 




9 


8 


11 


0 


3 


10 


1 


4 


7 


2 


Table 3 


Seq. #3 




2 




1 




5 




0 




3 




4 


Seq. #4 


3 




0 








5 




4 




2 




Seq. 3-4 


3 


2 


0 


1 


1 


5 


5 


0 


4 


3 


2 


4 


Table 4 


Position 


11 


10 


9 


8 


7 


6 


5 


4 


3 


2 


1 


0 


Seq.3-4 


3 


2 


0 


I 


1 


5 


5 


0 


4 
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